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Preface to M A First Course 
in Electrical and Computer 
Engineering" 2 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

This book was written for an experimental freshman course at the Univer- 
sity of Colorado. The course is now an elective that the majority of our 
electrical and computer engineering students take in the second semester 
of their freshman year, just before their first circuits course. Our depart- 
ment decided to offer this course for several reasons: 

1. we wanted to pique student' interest in engineering by acquainting 
them with engineering teachers early in their university careers and 
by providing with exposure to the types of problems that electrical 
and computer engineers are asked to solve; 

2. we wanted students entering the electrical and computer engineering 
programs to be prepared in complex analysis, phasors, and linear 
algebra, topics that are of fundamental importance in our discipline; 

3. we wanted students to have an introduction to a software application 
tool, such as MATLAB, to complete their preparation for practical 
and efficient computing in their subsequent courses and in their 
professional careers; 



2 This content is available online at <http://cnx.Org/content/m21476/l.7/>. 



4. we wanted students to make early contact with advanced topics 
like vector graphics, filtering, and binary coding so that they would 
gain a more rounded picture of modern electrical and computer 
engineering. 

In order to introduce this course, we had to sacrifice a second semester of 
Pascal programming. We concluded that the sacrifice was worth making 
because we found that most of our students were prepared for high-level 
language computing after just one semester of programming. 

We believe engineering educators elsewhere are reaching similar con- 
clusions about their own students and curriculums. We hope this book 
helps create a much needed dialogue about curriculum revision and that 
it leads to the development of similar introductory courses that encourage 
students to enter and practice our craft. 

Students electing to take this course have completed one semester of 
calculus, computer programming, chemistry, and humanities. Concur- 
rently with this course, students take physics and a second semester of 
calculus, as well as a second semester in the humanities. By omitting 
the advanced topics marked by asterisks, we are able to cover Complex 
Numbers (Section 1.1) through Linear Algebra (Section 4.1), plus two 
of the three remaining chapters. The book is organized so that the in- 
structor can select any two of the three. If every chapter of this book is 
covered, including the advanced topics, then enough material exists for a 
two-semester course. 

The first three chapters of this book provide a fairly complete coverage 
of complex numbers, the functions e* and e 3 , and phasors. Our depart- 
ment philosophy is that these topics must be understood if a student is 
to succeed in electrical and computer engineering. These three chapters 
may also be used as a supplement to a circuits course. A measured pace 
of presentation, taking between sixteen and eighteen lectures, is sufficient 
to cover all but the advanced sections in Complex Numbers (Section 1.1) 
through Phasors (Section 3.1). 

The chapter on "linear algebra" (Section 4.1) is prerequisite for all 
subsequent chapters. We use eight to ten lectures to cover it. We de- 
vote twelve to sixteen lectures to cover topics from Vector Graphics (Sec- 
tion 5.1) through Binary Codes (Section 7.1). (We assume a semester 
consisting of 42 lectures and three exams.) The chapter on vector graph- 
ics (Section 5.1) applies the linear algebra learned in the previous chapter 
(Section 4.1) to the problem of translating, scaling, and rotating images. 
"Filtering" (Section 6.1) introduces the student to basic ideas in averag- 
ing and filtering. The chapter on "Binary Codes" (Section 7.1) covers 
the rudiments of binary coding, including Huffman codes and Hamming 



codes. 

If the users of this book find "Vector Graphics" (Section 5.1) through 
"Binary Codes" (Section 7.1) too confining, we encourage them to supple- 
ment the essential material in "Complex Numbers" (Section 1.1) through 
"Linear Algebra" (Section 4.1) with their own course notes on additional 
topics. Within electrical and computer engineering there are endless pos- 
sibilities. Practically any set of topics that can be taught with conviction 
and enthusiasm will whet the student's appetite. We encourage you to 
write to us or to our editor, Tom Robbins, about your ideas for additional 
topics. We would like to think that our book and its subsequent editions 
will have an open architecture that enables us to accommodate a wide 
range of student and faculty interests. 

Throughout this book we have used MATLAB programs to illustrate 
key ideas. MATLAB is an interactive, matrix-oriented language that is 
ideally suited to circuit analysis, linear systems, control theory, commu- 
nications, linear algebra, and numerical analysis. MATLAB is rapidly 
becoming a standard software tool in universities and engineering compa- 
nies. (For more information about MATLAB, return the attached card 
in the back of this book to The MathWorks, Inc.) MATLAB programs 
are designed to develop the student's ability to solve meaningful problems, 
compute, and plot in a high-level applications language. Our students get 
started in MATLAB by working through "An Introduction to MATLAB," 
(Section 8.1) while seated at an IBM PC (or look-alike) or an Apple Mac- 
intosh. We also have them run through the demonstration programs in 
"Complex Numbers" (Section 1.1). Each week we give three classroom 
lectures and conduct a one-hour computer lab session. Students use this 
lab session to hone MATLAB skills, to write programs, or to conduct the 
numerical experiments that are given at the end of each chapter. We re- 
quire that these experiments be carried out and then reported in a short 
lab report that contains (i) introduction, (ii) analytical computations, 
(iii) computer code, (iv) experimental results, and (v) conclusions. The 
quality of the numerical results and the computer graphics astonishes stu- 
dents. Solutions to the chapter problems are available from the publisher 
for instructors who adopt this text for classroom use. 

We wish to acknowledge our late colleague Richard Roberts, who en- 
couraged us to publish this book, and Michael Lightner and Ruth Ravenel, 
who taught "Linear Algebra" (Section 4.1) and "Vector Graphics" (Sec- 
tion 5.1) and offered helpful suggestions on the manuscript. We thank 
C. T. Mullis for allowing us to use his notes on binary codes to guide 
our writing of "Binary Codes" (Section 7.1). We thank Cedric Demeure 
and Peter Massey for their contributions to the writing of "An Intro- 
duction to MATLAB" (Section 8.1) and "The Edix Editor" (Chapter 9). 



We thank Tom Robbins, our editor at Addison- Wesley, for his encourage- 
ment, patience, and many suggestions. We are especially grateful to Julie 
Fredlund, who composed this text through many drafts and improved it 
in many ways. We thank her for preparing an excellent manuscript for 
production. 

L. L. Scharf 
R. T. Behrens 
Boulder, Colorado 



To the Teacher: 

An incomplete understanding of complex numbers and phasors handicaps 
students in circuits and electronics courses, and even more so in advanced 
courses such as electromagnetics, optics, linear systems, control, and 
communication systems. Our faculty has decided to address this problem 
as early as possible in the curriculum by designing a course that drills 
complex numbers and phasors into the minds of beginning engineering 
students. We have used power signals, musical tones, Lissajous figures, 
light scattering, and RLC circuits to illustrate the usefulness of phasor 
calculus. "Linear Algebra" (Section 4.1) through "Binary Codes" (Sec- 
tion 7.1) introduce students to a handful of modern ideas in electrical and 
computer engineering. The motivation is to whet students' appetites for 
more advanced problems. The topics we have chosen - linear algebra, 
vector graphics, filtering, and binary codes - are only representative. 

At first glance, many of the equations in this book look intimidating 
to beginning students. For this reason, we proceed at a very measured 
pace. In our lectures, we write out in agonizing detail every equation that 
involves a sequence or series. For example, the sum J2 n =o 2; " ls written 
out as 

l + z + z 2 + --- + z N -\ (1) 

and then it is evaluated for some specific value of z before we derive the 
analytical result 1 ~ z Similarly, an infinite sequence like lim (l + -) 
is written out as 

1+2). (i+s)'"" ( 1+ ioo) '-' (2) 

and then it is evaluated for some specific x and for several values of n 
before the limit is derived. We try to preserve this practice of pedantic 



excess until it is clear that every student is comfortable with an idea and 
the notation for coding the idea. 

To the Student: 

These are exciting times for electrical and computer engineering. To cel- 
ebrate its silver anniversary, the National Academy of Engineering an- 
nounced in February of 1990 the top ten engineering feats of the previ- 
ous twenty-five years. The Apollo moon landing, a truly Olympian and 
protean achievement, ranked number one. However, a number of other 
achievements in the top ten were also readily identifiable as the products 
of electrical and computer engineers: 

1. communication and remote sensing satellites, 

2. the microprocessor, 

3. computer-aided design and manufacturing (CADCAM), 

4. computerized axial tomography (CAT scan), 

5. lasers, and 

6. fiber optic communication. 

As engineering students, you recognize these achievements to be impor- 
tant milestones for humanity; you take pride in the role that engineers 
have played in the technological revolution of the twentieth century. 

So how do we harness your enthusiasm for the grand enterprise of en- 
gineering? Historically, we have enrolled you in a freshman curriculum 
of mathematics, science, and humanities. If you succeeded, we enrolled 
you in an engineering curriculum. We then taught you the details of 
your profession and encouraged your faith that what you were studying is 
what you must study to be creative and productive engineers. The longer 
your faith held, the more likely you were to complete your studies. This 
seems like an imperious approach to engineering education, even though 
mathematics, physics, and the humanities are the foundation of engineer- 
ing, and details are what form the structure of engineering. It seems to 
us that a better way to stimulate your enthusiasm and encourage your 
faith is to introduce you early in your studies to engineering teachers who 
will share their insights about some of the fascinating advanced topics 
in engineering, while teaching you the mathematical and physical prin- 
ciples of engineering. But you must match the teacher's commitment 
with your own commitment to study. This means that you must attend 
lectures, read texts, and work problems. You must be inquisitive and 
skeptical. Ask yourself how an idea is limited in scope and how it might 
be extended to apply to a wider range of problems. For, after all, one 



of the great themes of engineering is that a few fundamental ideas from 
mathematics and science, coupled with a few principles of design, may be 
applied to a wide range of engineering problems. Good luck with your 
studies. 



Chapter 1 

Complex Numbers 



1.1 Complex Numbers: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



1.1.1 Notes to Teachers and Students: 

When we teach complex numbers to beginning engineering students, we 
encourage a geometrical picture supported by an algebraic structure. Ev- 
ery algebraic manipulation carried out in a lecture is accompanied by a 
care-fully drawn picture in order to fix the idea that geometry and algebra 
go hand- in- glove to complete our understanding of complex numbers. We 
assign essentially every problem for homework. 

We use the MATLAB programs in this chapter to illustrate the theory 
of complex numbers and to develop skill with the MATLAB language. 
The numerical experiment (Section 1.7) introduces students to the basic 
quadratic equation of electrical and computer engineering and shows how 
the roots of this quadratic equation depend on the coefficients of the 
equation. 

"Representing Complex Numbers in a Vector Space," (Section 1.5) is 
a little demanding for freshmen but easily accessible to sophomores. It 
may be covered for additional insight, skipped without consequence, or 



lr This content is available online at <http://cnx.Org/content/m21412/l.6/>. 



10 CHAPTER 1. COMPLEX NUMBERS 

covered after Chapter 4 (Section 4.1). "An Electric Field Computation," 
(Section 1.6) is well beyond most freshmen, and it is demanding for sopho- 
mores. Nonetheless, an expert in electromagnetics might want to cover 
the section "An electric Field Computation" (Section 1.6) for the insight 
it brings to the use of complex numbers for representing two-dimensional 
real quantities. 

1.1.2 Introduction 

It is hard to overestimate the value of complex numbers. They first arose 
in the study of roots for quadratic equations. But, as with so many 
other great discoveries, complex numbers have found widespread applica- 
tion well outside their original domain of discovery. They are now used 
throughout mathematics, applied science, and engineering to represent 
the harmonic nature of vibrating systems and oscillating fields. For ex- 
ample, complex numbers may be used to study 

i. traveling waves on a sea surface; 

ii. standing waves on a violin string; 

iii. the pure tone of a Kurzweil piano; 

iv. the acoustic field in a concert hall; 

v. the light of a He-Ne laser; 

vi. the electromagnetic field in a light show; 

vii. the vibrations in a robot arm; 

viii. the oscillations of a suspension system; 

ix. the carrier signal used to transmit AM or FM radio; 

x. the carrier signal used to transmit digital data over telephone lines; 

and 

xi. the 60 Hz signal used to deliver power to a home. 

In this chapter we develop the algebra and geometry of complex numbers. 
In Chapter 3 (Section 3.1) we will show how complex numbers are used 
to build phasor representations of power and communication signals. 

1.2 Complex Numbers: Geometry of Complex 
Numbers 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
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for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The most fundamental new idea in the study of complex numbers is the 
"imaginary number" j. This imaginary number is defined to be the square 
root of —1: 



-1 (1.1) 



r = -i. (i.2) 

The imaginary number j is used to build complex numbers x and y in 
the following way: 

z = x + jy. (1.3) 

We say that the complex number z has "real part" x and "imaginary part" 

y- 

z = Re [z] + jlm [z] (1.4) 

Re [z] = x; Im [z] = y. (1-5) 

In MATLAB, the variable x is denoted by real (z) , and the variable y is 
denoted by imag(z). In communication theory, x is called the "in-phase" 
component of z, and y is called the "quadrature" component. We call 
z =x + jy the Cartesian representation of z, with real component x and 
imaginary component y. We say that the Cartesian pair (x,y)codes the 
complex number z. 

We may plot the complex number z on the plane as in Figure 1.1. We 
call the horizontal axis the "real axis" and the vertical axis the "imaginary 
axis." The plane is called the "complex plane." The radius and angle of 
the line to the point z = x + jy are 



\Jx 2 + y 2 (1.6) 



tan^ (I) . (1.7) 



See Figure 1.1. In MATLAB, r is denoted by abs(z), and 8 is denoted 
by angle (z) . 
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maginary axis (J) 



VsinO =y 



z= x* jy= re 




J9 



Figure 1.1: Cartesian and Polar Representations of the Complex 
Number z 



The original Cartesian representation is obtained from the radius r 
and angle 9 as follows: 



x = rcos8 



(1.8) 



y = r sin v. 
The complex number z may therefore be written as 



(1.9) 



x + jy 

rcosd + jrsm9 

r ( cosO + j sin 6) . 



(1.10) 



The complex number cos# + jsin# is, itself, a number that may be 
represented on the complex plane and coded with the Cartesian pair 
(cos9,sm9). This is illustrated in Figure 1.2. The radius and angle to 
the point z = cosO + js'm9 are 1 and 9. Can you see why? 
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sin 



imaginary axis 



\0 



cosQ + /sin = e' 
real axis 



cost 



Figure 1.2: The Complex Number cosd + jsint 



The complex number cos# + js'mO is of such fundamental importance 
to our study of complex numbers that we give it the special symbol e^ e : 



J6 



cosd + jsm0. 



(1.11) 



As illustrated in Figure 1.2, the complex number e J ' e has radius 1 and 
angle 9. With the symbol e* e , we may write the complex number z as 



,j" 



(1.12) 



We call z = re^ e a polar representation for the complex number z. We 
say that the polar pair rZOcodes the complex number z. In this polar 
representation, we define \z\ = r to be the magnitude of z and arg (z) = 9 
to be the angle, or phase, of z: 



M 



(1.13) 



arg (z) 



(1.14) 



With these definitions of magnitude and phase, we can write the complex 
number z as 



z = \z\e 



jarg(z) 



(1.15) 
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Let's summarize our ways of writing the complex number z and record 
the corresponding geometric codes: 

z = x + jy = re' = \z\e j ara{z) . 

I I (1-16) 

(x,y) rZ6 

In "Roots of Quadratic Equations" (Section 1.4) we show that the defini- 
tion e J = cosO+jsinO is more than symbolic. We show, in fact, that e> is 
just the familiar function e x evaluated at the imaginary argument x = jd. 
We call e* 8 a "complex exponential," meaning that it is an exponential 
with an imaginary argument. 

Exercise 1.1 

Prove (j) " = (—1)™ and (j) n+ = (— l) n j. Evaluate j 3 , j 4 , j 5 . 
Exercise 1.2 

Prove e J[( v / 2 )+ m2v ] — j e J[(3ir/2)+m2n] _ _„• e J(0+m2ir) _ ]_ anc j 

p j(ir+m2TT) _ _^ plot these identities on the complex plane. 
(Assume m is an integer.) 

Exercise 1.3 

Find the polar representation z = re-? for each of the following 
complex numbers: 

a. z = l + jO; 

b. z = + jl; 

c. z = 1 + jl; 

d. z= -1- jl. 

Plot the points on the complex plane. 

Exercise 1.4 

Find the Cartesian representation z = x + jy for each of the 
following complex numbers: 

a. z = V2e^l 2 ; 



b. z = V2e^/ 4 ; 

c. z = e^/ 4 ; 

d. z = V2e 33 */ 2 . 



Plot the points on the complex plane. 

Exercise 1.5 

The following geometric codes represent complex numbers. De- 
code each by writing down the corresponding complex number 
z: 
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a. (0.7,-0.1) z=? 

b. (-1.0,0.5) z=1 

c. 1.6Ztt/8 z=1 

d. 0.4Z7tt/8 z =? 

Exercise 1.6 

Show that Im \jz] = Re [z] and Re [— jz] = Im[z]. Demo 1.1 
(MATLAB). Run the following MATLAB program in order to 
compute and plot the complex number e J for = i27r/360,i = 
1,2, ...,360: 



j=sqrt(-l) 

n=360 

for i=l :n, circle (i)=exp(j*2*pi*i/n) ;end; 

axis(' square' ) 

plot (circle) 

Replace the explicit for loop of line 3 by the implicit loop 



circle=exp ( j *2*pi* [1 : n] /n) ; 

to speed up the calculation. You can see from Figure 1.3 
that the complex number e J , evaluated at angles = 
27r/360, 2 (27r/360) , ..., turns out complex numbers that lie at 
angle and radius 1. We say that e^ e is a complex number that 
lies on the unit circle. We will have much more to say about the 
unit circle in Chapter 2. 
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Figure 1.3: The Complex Numbers e? e for < 8 < 2ty (Demo 
1.1) 



1.3 Complex Numbers: Algebra of Complex 
Numbers 3 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



3 This content is available online at <http://cnx.Org/content/m21408/l.6/>. 



17 



The complex numbers form a mathematical "field" on which the usual 
operations of addition and multiplication are defined. Each of these op- 
erations has a simple geometric interpretation. 

1.3.1 Addition and Multiplication. 

The complex numbers z\ and z 2 are 
added according to the rule 



zi + z 2 = (xi + jyi) + {x 2 + jyi) 
= (xi + x 2 ) + j (2/1 + 2/2) • 



(1.17) 



We say that the real parts add and the imaginary parts add. As illus- 
trated in Figure 1.4, the complex number z\ + z 2 is computed from a 
"parallelogram rule," wherein z\ + z 2 lies on the node of a parallelogram 
formed from z\ and z 2 . 

Exercise 1.7 

Let z\ = r\e^ x and z 2 = r 2 e : > 02 . Find a polar formula zj, =r%e- ' 3 
for z% = z\ + z 2 that involves only the variables r 1 ,r 2 ,^i, and 
2 . The formula for r 3 is the "law of cosines." 

The product of zj and Z2 is 

^1^2 = {xi + jyi) {x 2 + jy 2 ) 

(l.lo) 

= {xix 2 - yiy 2 ) + j (yix 2 + xxy 2 ) . 



IS 
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z x *z 2 




Figure 1.4: Adding Complex Numbers 



If the polar representations for Z\ and z 2 are used, then the product 
may be written as 4 



Z\Z 2 



= {r\cos9\ + jrisin9i) (r-icosd-i + jr^sinB-i) 

= ( T\ cos 6\r2 cos 82 — r\ sin &\ri sin 82) 

+ j ' ( 7*1 sin Q\T2 cos 62 + r\ cos Q\T2 sin O2) 

= rxr 2 cos (#1 + 2 ) + jrir 2 sin (61 + 9 2 ) 



72 j + jrir 2 sin[ 
e j (61+62) 



(1.19) 



We say that the magnitudes multiply and the angles add. As illustrated 
in Figure 1.5, the product z\Z2 lies at the angle (#1 + #2)- 



4 We have used the trigonometric identities cos (9\ + 82) = cos9\ cos 82 — sin 8\ sin 
&2 and sin (81 + 9 2 ) = sindi cos 8 2 + cosOi sin 9 2 to derive this result. 
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Z\Z 2 




Figure 1.5: Multiplying Complex Numbers 



Rotation. There is a special case of complex multiplication that will 
become very important in our study of phasors in the chapter on Phasors 
(Section 3.1). When Z\ is the complex number Z\ = r\e> ei and z 2 ls the 



complex number zi 



„j(k 



, then the product of z\ and z-i is 



z\Zi = z\e 



3<h 



r\e 



3(61+62) 



(1.20) 



As illustrated in Figure 1.6, Z1Z2 is just a rotation of z\ through the angle 

02- 
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Figure 1.6: Rotation of Complex Numbers 



Exercise 1.8 

Begin with the complex number z\ = x + jy = re 3 . Compute 
the complex number z 2 = jz\ in its Cartesian and polar forms. 
The complex number z 2 is sometimes called perp(zi). Explain 
why by writing perp(;?i) as zie^ 2 . What is #2? Repeat this 
problem for zj, = —jz\. 

Powers. If the complex number z\ multiplies itself TV times, then the 
result is 



\N 



fo^rfe*™ 1 . (1.21) 

This result may be proved with a simple induction argument. Assume 
(The assumption is true for k = 1.) Then use the recursion 
Iterate this recursion (or induction) until 



re 



v fc+i 



k jke x 



k 



r .k+i p j(k+i)e 1 



N 



k + 1 = N. Can you see that, as n ranges from n = 1, ..., 7V, the angle of 
zfrom 81 to 2#i, ..., to TV#i and the radius ranges from rj to r\, ..., to r 
? This result is explored more fully in Problem 1.19. 

Complex Conjugate. Corresponding to every complex number z 
x + jy = re 1 ® is the complex conjugate 



z* = x- jy = re~ je . (1.22) 

The complex number z and its complex conjugate are illustrated in Fig- 
ure 1.7. The recipe for finding complex conjugates is to "change jto — j. 
This changes the sign of the imaginary part of the complex number. 
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imaginary 

r 
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- z 




^V 




, real 




\^> 




1 
X 


-y- 


r 




s 2* 



Figure 1.7: A Complex Variable and Its Complex Conjugate 



Magnitude Squared. The product of z and its complex conjugate 
is called the magnitude squared of z and is denoted by \z\ : 



\z\ = z* z = (x — jy) (x + jy) = x + y = re 3 re 3 = r . (1-23) 

Note that \z\ = r is the radius, or magnitude, that we defined in "Geom- 
etry of Complex Numbers" (Section 1.2). 

Exercise 1.9 

Write z* as z* = zw. Find w in its Cartesian and polar forms. 

Exercise 1.10 

Prove that angle (Z2Z*) =Bi — d\. 

Exercise 1.11 

Show that the real and imaginary parts of z = x + jy may be 
written as 

(1.24) 



Re[z}= ^(z + z*) 



Im [z] = 2j (z — z*) 



(1.25) 



Commutativity, Associativity, and Distributivity. The complex 
numbers commute, associate, and distribute under addition and multipli- 
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cation as follows: 



z\ + z 2 = z 2 + Z\ 
Z\z 2 = z 2 zi 



(1.26) 



(zi + z 2 ) + z 3 = zi + O2 + z 3 ) 

z\ {z 2 z 3 ) = (Z1Z2) z 3 (1-27) 

z\ {z 2 + Z 3 ) = Z 1 Z 2 + ZlZ 3 . 

Identities and Inverses. In the field of complex numbers, the complex 
number 0+ jO (denoted by 0) plays the role of an additive identity, and the 
complex number 1 + jO (denoted by 1) plays the role of a multiplicative 
identity: 

z+Q = z = 0+z 

(1.28) 
z\ = z = \z. 

In this field, the complex number —z = —x + j (—y) is the additive 
inverse of z, and the ( 
multiplicative inverse: 

z+{-z) = 



inverse of z, and the complex number z x = i2 ^_ 2 + j I ^A ) is the 



-1 



1. 



(1.29) 



Exercise 1.12 

Show that the additive inverse of z = re^ 6 may be written as 

re i( 8 + 7r ). 

Exercise 1.13 

Show that the multiplicative inverse of z may be written as 



-1 ! „* 1 



(x-jy). (1.30) 



z*z x 2 + y 2 

Show that z*z is real. Show that z~ x may also be written as 

z- 1 = r- x e- i(> . (1.31) 

Plot z and z~ Y for a representative z. 

Exercise 1.14 

Prove (j) -1 = -j. 
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Exercise 1.15 

Find z~ x when z = 1 + jl. 
Exercise 1.16 

Prove (z _1 ) = {z*)~ = r~ x e> e = -=—z. Plot z and (z~ x ) for 
a representative z. 

Exercise 1.17 

Find all of the complex numbers z with the property that 
j z = —z*. Illustrate these complex numbers on the complex 
plane. 

Demo 1.2 (MATLAB). Create and run the following script file (name 
it Complex Numbers) 5 

clear, clg 
j=sqrt(-l) 

zl=l+j*.5,z2=2+j*1.5 
z3=zl+z2,z4=zl*z2 
z5=conj (zl) ,z6=j*z2 

avis ([-4 4 -4 4] ), axis ( 'square' ) .plot (zl , '0' ) 
hold on 

plot(z2, '0') ,plot(z3, '+') ,plot(z4,'*'), 
plot(z2, '0') ,plot(z3, '+') ,plot(z4, '*') , 
plot(z5, 'x') ,plot(z6, 'x') 



3 If you are using PC-MATLAB, you will need to name your file cmplxnos.m. 
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Figure 1.8: Complex Numbers (Demo 1.2) 



With the help of Appendix 1, you should be able to annotate each line 
of this program. View your graphics display to verify the rules for add, 
multiply, conjugate, and perp. See Figure 1.8. 

Exercise 1.18 

Prove that z° = 1. 

Exercise 1.19 

(MATLAB) Choose Zl = 1.05e J ' 27r / 16 and z 2 = 0.95e^ 27r / 16 . 
Write a MATLAB program to compute and plot z™ and z% for 
n = 1, 2, ..., 32. You should observe a figure like Figure 1.9. 
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Figure 1.9: Powers of z 



1.4 Complex Numbers: Roots of Quadratic 
Equations 6 

You probably first encountered complex numbers when you studied values 
of z (called roots or zeros) for which the following equation is satisfied: 

az 2 + bz + c=0. (1.32) 

For a / (as we will assume), this equation may be written as 



2 b 

z 2 + -z- 
a 



0. 



(1.33) 



Let's denote the second-degree polynomial on the left-hand side of this 
equation by p(z): 



p(z) = z H — z H — . 
a a 



(1.34) 



This is called a monic polynomial because the coefficient of the highest- 
power term (z 2 ) is 1. When looking for solutions to the quadratic equation 
0, we are really looking for roots (or zeros) of the polynomial 



z 2 +^z+: 



p(z). The fundamental theorem of algebra says that there are two such 



6 This content is available online at <http://cnx.Org/content/m21415/l.6/>. 
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roots. When we have found them, we may factor the polynomial p (z) as 
follows: 

b c 

p ( z ) = z 2 + -z + - = (z - zi) (z - z 2 ) . (1.35) 

a a 

In this equation, zj and Z2 are the roots we seek. The factored form 
p(z) =(z — zi) (z — Z2) shows clearly that p(z 1 ) = p(z 2 ) = 0, meaning 
that the quadratic equation p(z) = is solved for z = z\ and z = z 2 . 
In the process of factoring the polynomial p(z), we solve the quadratic 
equation and vice versa. 

By equating the coefficients of z 2 , z 1 , and z° on the left-and right-hand 
sides of (1.35), we find that the sum and the product of the roots z\ and 
z-i obey the equations 

Zl + Z2 = "-. (1.36) 

You should always check your solutions with these equations. 

Completing the Square. In order to solve the quadratic equation 
z 2 +-z+ £ = (or, equivalently, to find the roots of the polynomial 
z 2 +-z + -, we "complete the square" on the left-hand side of (1.33): 

la) \2a/ a 

This equation may be rewritten as 

2 / -, \ 2 

2a 
We may take the square root of each side to find the solutions 



■-£) =(i) (b 2 -4ac). (1.38) 



^i,2 = -^±^V / & 2 -4ac. (1.39) 

2a 2a 

Exercise 1.20 

With the roots z\ and z 2 defined in Equation 1.29, prove that 

[z — Z\) (z — z 2 ) is, indeed, equal to the polynomial z 2 + -z+ -. 
Check that Z\ + z 2 = — - and z\Zi = - 

In the equation that defines the roots z\ and z 2 , the term b 2 — 4ac is 
critical because it determines the nature of the solutions for z\ and z 2 . In 
fact, we may define three classes of solutions depending on b 2 — Aac. 
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(i) Overdamped (b 2 — Aac > 0). In this case, the roots z\ and z 2 



Zl,2 



2a 2a 



Aac. 



(1.40) 



These two roots are real, and they are located symmetrically about the 
point — ■£-■ When 6 = 0, they are located symmetrically about at 
the points ±^-\/— 4oc. (In this case, — Aac > 0.) Typical solutions are 
illustrated in Figure 1.10. 



.b_ 

20. 



Z\ 



(a) 



Z\ 



1 

20, 



Zi 



(b) 



(c) 



Figure 1.10: Typical Roots in the Overdamped Case; (a) b/2a > 
0, Aac > 0, (b) b/2a > 0, Aac < 0, and (c) b/2a = 0, 4ac < 



Exercise 1.21 

Compute and plot the roots of the following quadratic equations: 

a. z 2 + 2z+ i = 0; 



b. z 2 + 2a 

v2 _ 1 _ 
2 



? 



C. 2: 



2 -0; 
o. 



For each equation, check that z\ + z-i = — - and z\Zi = - 

(ii) Critically Damped (b 2 — Aac = 0). In this case, the roots z\ and 
Z2 are equal (we say they are repeated): 



z\ = z 2 



b 
'2a' 



(1.41) 



These solutions are illustrated in Figure 1.11. 
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2a 



Z\, Zo 



(a) 



(b) 



± 

2a 
-»• — 



Z X ,Z, 



Figure 1.11: Roots in the Critically Damped Case; (a) b/2a > 0, 
and (b) b/2a < 



Exercise 1.22 

Compute and plot the roots of the following quadratic equations: 



a. 


z 2 


+ 2z 


+ 1 


= 


b. 


z 2 


-1z 


+ 1 


= 


c. 


z 2 


= 0. 







For each equation, check that z\ + z 2 



and z\Zi 



(iii) Underdamped (b 2 — Aac < 0). The underdamped case is, by far, 
the most fascinating case. When b 2 — Aac < 0, then the square root in 
the solutions for Z\ and £ 2 ((1.39)) produces an imaginary number. We 



may write b 2 — Aac as — (4c 



Zl,2 



- b ) and write z\$. as 

fa ± lV-(^C-b 2 ) 



(1.42) 



= 'I ± jf a VAa^¥. 

These complex roots are illustrated in Figure 1.12. Note that the roots 
are 

purely imaginary when 6=0, producing the result 



Zl,2 = ±j 



(1.43) 
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zaUac-b' 






±-Mac-b 2 -- 



■+z± 

x 2a 



(a) 



(b) 



(c) 



Figure 1.12: Figure 1.12: Typical Roots in the Underdamped 
Case; (a) b/2a > 0, (b)b/2a < 0, and (c) b/2a = 



In this underdamped case, the roots z\ and zi are complex conjugates: 

Z2 = z{. (1.44) 

Thus the polynomial p(z) = z 2 + -z + - = (z — z\) (z — Z2) also takes 
the form 



p(z) = (z-z^iz-zl) 

= z 2 -2Re[z 1 }z+ \zi\ 



(1.45) 



Re [z\] and \z\\ 2 are related to the original coefficients of the polynomial 
as follows: 



2Re [z{\ 



(1.46) 
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N 2 =" (1-47) 

a 

Always check these equations. 

Let's explore these connections further by using the polar representa- 
tions for Z\ and z 2 : 

z 1>2 = re ±: > e . (1.48) 

Then (1.45) for the polynomial p(z) may be written in the "standard 
form" 



p(z) = (z — rei ^ (z — re jff ) 
= z 2 — 2r cos 6z + r 2 . 



(1.49) 



(1.46) is now 



2rcos6» = -2. 

a 

r 2 = £ 

a 

These equations may be used to locate z\ t 2 = re ±J ' e 



±cos 



(1.50) 



(1.51) 



Exercise 1.23 

Prove that p (z) may be written as p (z) = z 2 — 2r cos Oz + r 2 
in the underdamped case. 

Exercise 1.24 

Prove the relations in (1.51). Outline a graphical procedure 
for locating z\ = re J and z^ = re~i from the polynomial 

Exercise 1.25 

Compute and plot the roots of the following quadratic equations: 

a. z 2 + 2z + 2 = 0; 

b. z 2 - 2z + 2 = 0; 

c. z 2 + 2 = 0. 

For each equation, check that 2Re [21,2] = and |zi,2| 2 = -■ 
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1.5 Complex Numbers: Representing Complex 
Numbers in a Vector Space 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

So far we have coded the complex number z = x + jy with the Cartesian 
pair (x,y) and with the polar pair (rZ9). We now show how the complex 
number z may be coded with a two-dimensional vector z and show how 
this new code may be used to gain insight about complex numbers. 

Coding a Complex Number as a Vector. We code the complex 



number z = x + jy with the two-dimensional vector z 



x 

y 



x + jy = z ■£> z 



x 

y 



(1.52) 



We plot this vector as in Figure 1.13. We say that the vector z belongs 
to a "vector space." This means that vectors may be added and scaled 
according to the rules 



Zl +z 2 



X\ + Xi 

2/1 + 2/2 



WL 



ax 

ay 



(1.53) 



(1.54) 



7 This content is available online at <http://cnx.Org/content/m21414/l.6/>. 
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Figure 1.13: The Vector z Coding the Complex Number z 



Furthermore, it means that an additive inverse — z, an additive identity 
0, and a multiplicative identity 1 all exist: 



z+(-z) = 



(1.55) 



/z 



(1.56) 



The vector is 



Prove that vector addition and scalar multiplication satisfy these prop- 
erties of commutation, association, and distribution: 



Zl + Z 2 = 22 + Zi 



(1.57) 



(zi + z 2 ) + z 3 = Zl + (z 2 + z 3 ) 



(1.58) 



a (6z) = (a&) z 



(1.59) 



a (zi + z 2 ) = azi + az 2 . 



(1.60) 



Inner Product and Norm. The inner product between two vectors 
zi and z 2 is defined to be the real number 



(zi,z 2 ) = xix 2 H- 2/12/2- 



(1.61) 
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We sometimes write this inner product as the vector product (more on 
this in Linear Algebra (Section 4.1)) 



(zi,z 2 ) 



T 

z{z 2 



[x\ 2/i J 



x 2 

2/2 



(xix 2 + 2/12/2) • 



(1.62) 



Exercise 1.26 

Prove (z!,z 2 ) = (z 2 ,zi). 

When zi = Z2 = z, then the inner product between z and itself is the 
norm squared of z: 



(z,z) = x 2 + y 2 



(1.63) 



These properties of vectors seem abstract. However, as we now show, they 
may be used to develop a vector calculus for doing complex arithmetic. 

A Vector Calculus for Complex Arithmetic. The addition of two 
complex numbers Z\ and z 2 corresponds to the addition of the vectors zi 
and z 2 : 



z\ + z 2 <(=> zi + z 2 



x\ + x 2 
2/1 + 2/2 



(1.64) 



The scalar multiplication of the complex number z 2 by the real number 
x\ corresponds to scalar multiplication of the vector z 2 by x\ : 



(1.65) 



Similarly, the multiplication of the complex number z 2 by the real number 

2/1 is 









- 


x\z 2 <£=> x\ 


x 2 


= 


X\X 2 




2/2 




xiy 2 









- 


z 2 *-* 2/1 


x 2 

2/2 


= 


V\x 2 
2/12/2 



(1.66) 



The complex product z\z 2 = {x\ + jyi) z 2 is therefore represented as 



^1^2 



a;i^2 - 2/12/2 
xiy 2 + y\x 2 



(1.67) 
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This representation may be written as the inner product 



ZlZ 2 = z 2 zi <- 

where v and w are the vectors v 
defining the matrix 

X2 
2/2 



(v,zi) 
(w,zi) 

X2 

-2/2 



and w 



2/2 

x 2 



-2/2 

x 2 



(1.68) 



By 



(1.69) 



we can represent the complex product Z\Z 2 as a matrix- vector multiply 
(more on this in Linear Algebra (Section 4.1)): 



•21-22 = Z 2 Zi 



x 2 -y 2 
2/2 x 2 



Xl 

2/1 



(1.70) 



With this representation, we can represent rotation as 



ze> e = e j9 z 



cosO —sinO 
sin6 cosO 



X2 



(1.71) 



We call the matrix 



cosO —sinQ 
sinO cos8 



a "rotation matrix." 



Exercise 1.27 

Call R (9) the rotation matrix: 



R(0) 



cos6 —sinO 
sind cos8 



(1.72) 



Show that R(— 9) rotates by (—9). What can you say about 
R(-0)w when w = R(0)z? 
Exercise 1.28 

Represent the complex conjugate of z as 



z ^ 



a b 
c d 



x 
V 



(1.73) 
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and find the elements a, b, c, and d of the matrix. 

Inner Product and Polar Representation. From the norm of a vec- 
tor, we derive a formula for the magnitude of z in the polar representation 



z = re 



J 8 ■ 



2\l/2 



r = (x 2 + y 2 ) 

If we define the coordinate vectors ei 
we can represent the vector z as 



(z,z) 



1/2 



and e2 



z = (z,ei)ei + (z,e 2 )e 2 . 



(1.74) 
, then 

(1.75) 



See Figure 1.14. From the figure it is clear that the cosine and sine of 
the angle 9 are 



cost 



feO. S in0= { ^ 



(1.76) 




(z.eJ 



Figure 1.14: Representation of z in its Natural Basis 



This gives us another representation for any vector z: 
z = I|z||cos0ei + ||z||sin^e2. 



(1.77) 
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The inner product between two vectors z\ and z-i is now 

(zi,z 2 ) = [(zi,ei)ef (zi,e 2 )e^] 



(z 2 ,ei)ei 

(z 2 ,e 2 )e 2 
(zi,ei) (z 2 ,ei) + (zi,e 2 ) (z 2 ,e 2 ) 
|zi||cos6'i||z 2 ||cos6 l 2 + llzill sin 6<i||z 2 ||sm0 2 . 



(1.78) 



It follows that cos (6* 2 — 6\) = cosQ-i cos 6\ + sind\sinOi may be written 

as 

COS (8 2 -6l)= m (Z ||'m 2) || ( L79 ) 

ll z l|| ll z 2|| 

This formula shows that the cosine of the angle between two vectors zx 
and z 2 , which is, of course, the cosine of the angle of ziz\, is the ratio of 
the inner product to the norms. 

Exercise 1.29 

Prove the Schwarz and triangle inequalities and interpret them: 

(Schwarz) ( Zl ,z 2 ) 2 < ||zi|| 2 ||z 2 || 2 (1.80) 



(triangle) I zi - z 2 || < ||zi - z 3 || + ||z 2 - z3 ||. (1-81) 



1.6 Complex Numbers: An Electric Field 
Computation 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

We have established that vectors may be used to code complex numbers. 
Conversely, complex numbers may be used to code or represent the or- 
thogonal components of any two-dimensional vector. This makes them 



3 This content is available online at <http://cnx.Org/content/m21410/l.6/>. 
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invaluable in electromagnetic field theory, where they are used to repre- 
sent the components of electric and magnetic fields. 

The basic problem in electromagnetic field theory is to determine the 
electric or magnetic field that is generated by a static or dynamic dis- 
tribution of charge. The key idea is to isolate an infinitesimal charge, 
determine the field set up by this charge, and then to sum the fields 
contributed by all such infinitesimal charges. This idea is illustrated in 
Figure 1.15, where the charge A, uniformly distributed over a line segment 
of length dx at point — x, produces a field dE (x) at the test point (0, h). 
The field dE (x) is a "vector" field (as opposed to a "scalar" field), with 
components E\ (x) and Ei (x). The intensity or field strength of the field 
dE (x) is 



\dE(x)\ 



Xdx 



Aneo {h 2 + x 2 ) 



(1.82) 



dE 9 (X) 




Figure 1.15: Infinitesimal Charge Xdx Producing Field dE (x) 



But the field strength is directed at angle 9 (x) , as illustrated in Fig- 
ure 1.15. The field dE (x) is real with components dE\ (x) and dE 2 (x), 
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but we code it as a complex field. We say that the "complex" field at test 
point (0, h) is 

dE(x) = - %g—-e>°W (1.83) 

v ; 4tt£ {h 2 + x 2 ) v ; 

with components dE\ (x) and dE 2 (x). That is, 

dE (x) = dE x (x) + jdE 2 (x) (1.84) 

Xdx 

dE ^ = 4^WT^) cose ^ (L85) 

dE ^ = ^w^) sin9{x) - (L86) 

For charge uniformally distributed with density A along the x-axis, the 
total field at the test point (0, h) is obtained by integrating dE: 

/oo ^ 
—5 ^ [cosd (x) + jsinO (x)] dx. (1.87) 
-oo 4:ire (h 2 + x 2 ) 

The functions cos 8 (x) and sinO (x) are 

cosO (x) = X —tb'i sinB 0) = T7? ( L88 ) 

{x 2 + h 2 ) 1/2 {x 2 + h 2 ) 1/2 

We leave it as a problem to show that the real component E x of the field 
is zero. The imaginary component E 2 is 

f°° Xh dx , 

E = jE 2 = j / — (1.89) 

= Jt^ — rrd-oo (i-90) 



Xh 

47T£n 



1 1 

h 2 + h 2 



l^h ^ 



We emphasize that the field at (0, h) is a real field. Our imaginary answer 
simply says that the real field is oriented in the vertical direction because 
we have used the imaginary part of the complex field to code the vertical 
component of the real field. 
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Exercise 1.30 

Show that the horizontal component of the field E is zero. In- 
terpret this finding physically. 

From the symmetry of this problem, we conclude that the field around 
the infinitely long wire of Figure 1.15 is radially symmetric. So, in polar 
coordinates, we could say 

E(r,9) = — — (1.93) 

27T£ r 

which is independent of 8. If we integrated the field along a radial line 
perpendicular to the wire, we would measure the voltage difference 

V (n) - V (r ) = I * 7-^rfr = [logn - logr ] . (1.94) 

J ro 27re r 2ne 

An electric field has units of volts/meter, a charge density A has units 
of coulombs/meter, and e nas units of coulombs/volt-meter; voltage has 
units of volts (of course). 

1.7 Complex Numbers: Numerical Experi- 
ment (Quadratic Roots) 9 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

There is a version of the quadratic equation that will arise over and over 
again in your study of electrical and mechanical systems: 

s 2 + 2£u) s + u>% = 0. (1.95) 

For reasons that can only become clear as you continue your study of 
engineering, the parameter loq is called a resonant frequency, and the 
parameter £ > is called a damping factor. In this experiment, you will 
begin by 

1. finding the "underdamped" range of values £ > for which the roots 
Sj and s 2 are complex; 



9 This content is available online at <http://cnx.Org/content/m21413/l.6/>. 
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2. finding the "critically damped" value of £ > that makes the roots 
Sj and S2 equal; and 

3. finding the "overdamped" range of values £ > for which s 2 and s 2 
are real. 

4. For each of these ranges, find the analytical solution for s\ t 2 as a 
function of loq and £; write your solutions in Cartesian and polar 
forms and present your results as 

,0<£<£c 
«i,2 = { ,£ = £c (1-96) 

where £ c is the critically damped value of £. Write a MATLAB 
program that computes and plots s\^ for loq fixed at ujq = 1 and 
^ variable between 0.0 and 2.0 in steps of 0.1. Interpret all of your 
findings. 

Now organize the coefficients of the polynomial s 2 + 2£s + l into the array 
[12£1]. Imbed the MATLAB instructions 

r=roots([l 2*e 1]) ; 
plot(real(r(l)) ,imag(r(l)) , 'o') 
plot (real (r (2)) ,imag(r(2)) , 'o') 

in a for loop to compute and plot the roots of s 2 + 2£s + 1 as £ ranges 
from 0.0 to 2.0. Note that r is a 1 x 2 array of complex numbers. You 
should observe Figure 1.16. We call this "half circle and line" the locus of 
roots for the quadratic equation or the "root locus" in shorthand. 
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Figure 1.16: Roots of Quadratic Equation 
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Chapter 2 

The Functions e"x and 

e-je 

2.1 The Functions e~x and e~j#: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

2.1.1 Notes to Teachers and Students 

It is essential to write out, term-by-term, every sequence and sum in 
this chapter. This demystifies the seemingly mysterious notation. The 
example on compound interest shows the value of limiting arguments in 
everyday life and gives e x some real meaning. The function e? , covered 
in the section "The Function of e> e and the Unit Circle (Section 2.3) 
and "Numerical Experiment (Approximating e> e (Section 2.7), must be 
understood by all students before proceeding to "Phasors" (Section 3.1). 
The Euler and De Moivre identities provide every tool that students need 
to derive trigonometric formulas. The properties of roots of unity are 
invaluable for the study of phasors in "Phasors" (Section 3.1). 

The MATLAB programs in this chapter are used to illustrate se- 
quences and series and to explore approximations to sind and cosO. 



1 This content is available online at <http://cnx.Org/content/m21479/l.5/>. 
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The numerical experiment in "Numerical Experiment (Approximating e" 
(Section 2.7) illustrates, geometrically and algebraically, how approxima- 
tions to e^ e converge. 

"Second-Order Differential and Difference Equations" (Section 2.6) is 
a little demanding for freshmen, but we give it a once-over-lightly to illus- 
trate the power of quadratic equations and the functions e* and e J . This 
section also gives a sneak preview of more advanced courses in circuits 
and systems. 

2.1.2 Introduction 

It is probably not too strong a statement to say that the function e x is 
the most important function in engineering and applied science. In this 
chapter we study the function e x and extend its definition to the function 
e^ 6 . This study clarifies our definition of e^ 6 from "Complex Numbers" 
(Section 1.1) and leads us to an investigation of sequences and series. We 
use the function e^ e to derive the Euler and De Moivre identities and to 
produce a number of important trigonometric identities. We define the 
complex roots of unity and study their partial sums. The results of this 
chapter will be used in "Phasors" (Section 3.1) when we study the phasor 
representation of sinusoidal signals. 



2.2 The Functions e~x and e~j(9: The Function 
e x 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Many of you know the number e as the base of the natural logarithm, 
which has the value 2.718281828459045. . . . What you may not know is 
that this number is actually defined as the limit of a sequence of approx- 
imating numbers. That is, 



e = Um /„ (2.1) 



n — >oo 



/„=(! + -) , n=l,2, ... (2.2) 



2 This content is available online at <http://cnx.Org/content/m21485/l.7/>. 
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This means, simply, that the sequence of numbers 
(1 + 1) , (l + |) , (l + |) , . . . , gets arbitrarily close to 
2.718281828459045. . . . But why should such a sequence of 
numbers be so important? In the next several paragraphs we answer this 
question. 

Exercise 2.1 

(MATLAB) Write a MATLAB program to evaluate the ex- 
pression f n = (l + -) for n = 1,2,4,8,16,32,64 to show that 
/„ « e for large n. 

Derivatives and the Number e. The number f n = (l + -) arises in 
the study of derivatives in the following way. Consider the function 



/(*) 



a > 1 



(2.3) 



and ask yourself when the derivative of / (x) equals / (aj). The function 
/ (a;) is plotted in Figure 2.1 for a > 1. The slope of the function at point 
x is 



df(x) 
dx 



Urn s- 



t 

a x lim — 



AnO 



(2.4) 




Figure 2.1: The Function / (a;) = a x 
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If there is a special value for a such that 

a Ax - 1 , N 

torn — t = 1, (2.5) 

then 4-f ' (x) would equal f(x). We call this value of a the special (or 
exceptional) number e and write 

f{x) = eX (2.6) 

£/(*) = «*■ 

The number e would then be e = / (1). Let's write our condition that 

Ax i 

a Az converges to 1 as 



,4i 



1 S Ax, Axsmall (2.7) 



e^{l + Ax) 1/Ax . (2.8) 

Our definition of e = lira (l + -) amounts to defining Aa; = - and 

n^oo n n 

allowing n — > oo in order to make Ax — > 0. With this definition for e, it 
is clear that the function e x is defined to be (e) x : 



e x = Urn (1 + Ax) x/ax . (2.9) 



\x/ Ax 

By letting Ax = - we can write this definition in the more familiar form 

(x \ n 
1 + - (2.10) 

Tl / 

This is our fundamental definition for the function e x . When evaluated 
at x = 1, it produces the definition of e given in (2.1). 
The derivative of e x is, of course, 

— e x = limn(l + -Y - = e x . (2.11) 

dx n— >oo \ n/ n 

This means that Taylor's theorem 3 may be used to find another charac- 
terization for e x : 



^n=0 Ldx" c Ja;=0n!- i ' (2 12) 



J a;- 
oo x n 



Eoo 
n=0 



3 Taylor's theorem says that a function may be completely characterized by all of 
its derivatives (provided they all exist). 
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When this series expansion for e x is evaluated at x = 1, it produces the 
following series for e: 



e = 



oo 

£ -y ( 2 - 13 ) 



n. 

In this formula, n! is the product n (n — 1) (n — 2) • • • (2) 1. Read n! as 
"n factorial." 

Exercise 2.2 

(MATLAB) Write a MATLAB program to evaluate the sum 



S N = J2 I (2.14) 

n=0 

for A^ = 1,2,4,8,16,32,64 to show that SW ^ e for large N. 
Compare S^4 with f^ from Exercise 2.1. Which approximation 
do you prefer? 

Compound Interest and the Function e x . There is an example from 
your everyday life that shows even more dramatically how the function 
e x arises. Suppose you invest Vb dollars in a savings account that offers 
100a;% annual interest. (When x = 0.01, this is 1%; when x = 0.10, this 
is 10% interest.) If interest is compounded only once per year, you have 
the simple interest formula for V\, the value of your savings account after 
1 compound (in this case, 1 year): 

V\ = (1 + x) Vq. This result is illustrated in the block diagram of 
Figure 2.2(a). In this diagram, your input fortune V is processed by 
the "interest block" to produce your output fortune Vj. If interest is 
compounded monthly, then the annual interest is divided into 12 equal 
parts and applied 12 times. The compounding formula for V12, the value 
of your savings after 12 compounds (also 1 year) is 

1 + ^) V . (2.15) 

This result is illustrated in Figure 2.2(b). Can you read the block di- 
agram? The general formula for the value of an account that is com- 
pounded n times per year is 

(x \ n 
1 + - V . (2.16) 

n> 

V n is the value of your account after n compounds in a year, when the 

annual interest rate is 100x%. 
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V Q 



V 



(1+X) 



V] = c i -X) Vo 



(a) 



"T*> 



Vi 



(1-£) 



Vi 



■^2- (1 



V, 



12 

>- 



*#' F n = ti-i) 2 V ]0 ... = ( |^) IJ V 
(b) 



Figure 2.2: Block Diagram for Interest Computations; (a) Simple 
Annual Interest, and (b) Monthly Compounding 



Exercise 2.3 

Verify in (2.16) that a recursion is at work that terminates at 
V n . That is, show that V i+1 = (l + f ) Vi for i = 0, 1, ...,n - 1 
produces the result V n = (l + -) Vo- 

Bankers have discovered the (apparent) appeal of infinite, or continuous, 

compounding: 



Voo = lim(l+ -) V . 

n—>oo\ n) 

We know that this is just 



Voo = e x V . 



(2.17) 



(2.18) 



So, when deciding between lOCtei % interest compounded daily and 
100x2% interest compounded continuously, we need only compare 



365/ 



365 



(2.19) 



We suggest that daily compounding is about as good as continuous com- 
pounding. What do you think? How about monthly compounding? 

Exercise 2.4 

(MATLAB) Write a MATLAB program to compute and plot 
simple interest, monthly interest, daily interest, and continuous 
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interest versus interest rate 100a;. Use the curves to develop a 
strategy for saving money. 



2.3 The Functions e~x and e~j#: The Function 
e~j6 and the Unit Circle 4 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Let's try to extend our definitions of the function e x to the argument 
x = jQ. Then e J is the function 

e 30 = lim 1 + j- I (2.20) 

n^oo y nj 

The complex number 1 + j — is illustrated in Figure 2.3. The radius to 

ft ( H 2 \ 1 ^ 2 

the point l + j-isr=il + ^\ and the angle is (f> 

/ 2 \ ™/ 2 



means that the n power of 1 + j^- has radius r n = ( 1 + ^p ) and 
angle n<j) = ntan" 1 - (Recall our study of powers of z.) Therefore the 
complex number (l + j-j may be written as 

9\ n ( 2 \ n/2 \ ( _ 1 9\ ( _ x 9 

1+j— =1-| cos ntan — + jsin ntan — 

n ) \ n z ) \ nj \ n 

(2.21) 

( 2 \ n/2 
1 + ^1 2 = 1, and ntan' 1 - = n- = 9. Therefore 

(l + j— ) is approximately 

9\ " 
1 + 7- ) = 1 (cose + j sin6). (2.22) 

n J 

( 1 +if)" = 1 ( cose + j sin 6»). 

This finding is consistent with our previous definition of e^ e ! 



4 This content is available online at <http://cnx.Org/content/m21486/l.7/>. 
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Figure 2.3: The Complex Number 1 + j- 



The series expansion for e^ e is obtained by evaluating Taylor's formula 
at x = j9: 



oo 1 



(2.23) 



When this series expansion for e^ is written out, we have the formula 
j0 _ y^oo i (■iff\ 2n i V 00 i (iQ\ 2n+1 



_ ^°° (~ 1 )" fl2ra I ,-y°° (-1)" fl27t+l 

— Z^n=0 (2n)! "•" J Z^n=0 (2n+l)! ^ 

It is now clear that cosO and sinO have the series expansions 

(-1)\ 2 „ 



^ = E 



sin 



(2n)! 

( — 1) o2n+l 



(2n+l 



r^- 



(2.24) 



(2.25) 



(2.26) 



n=0 



When these infinite sums are truncated at N — 1, then we say that we 
have N-term approximations for cosO and sinO: 



N-l n 



n=0 

N-l 



(2n)! 



( ■*■) p2n+l 



S i n e 91 y ^-^-„ 



(2.27) 
(2.28) 
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The ten-term approximations to cos8 and sinO are plotted over exact 
expressions for cosO and sinO in Figure 2.4. The approximations are very 
good over one period (0 < 9 < 2ir), but they diverge outside this interval. 
For more accurate approximations over a larger range of 9 s, we would 
need to use more terms. Or, better yet, we could use the fact that cos9 
and sin9 are periodic in 9. Then we could subtract as many multiples of 
2n as we needed from 9 to bring the result into the range [0,27r] and use 
the ten-term approximations on this new variable. The new variable is 
called ^-modulo 2ir. 




4 6 8 10 

angle in radians 



12 



14 



Figure 2.4: Ten-Term Approximations to cosO and sinO 



Exercise 2.5 

Write out the first several terms in the series expansions for 
cos9 and sin9. 

Demo 2.1 (MATLAB). Create a MATLAB file containing the following 
demo MATLAB program that computes and plots two cycles of cos9 and 
sin 9 versus 9. You should observe Figure 2.5. Note that two cycles take 
in 2 (27r) radians, which is approximately 12 radians. 



clg; 
j = sqrt(-l) ; 
theta = 0:2*pi/50:4*pi; 
s = sin(theta) ; 
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c = cos (theta) ; 

plot (theta, s) ; 

elabel( 'theta in radians'); 

ylabel('sine and cosine'); 

hold on 

plot (theta, c) ; 

hold off 



a 0.5 



■55 -0.5 




4 6 8 10 

angle in radians 



Figure 2.5: The Functions cos9 and sinB 



Exercise 2.6 

(MATLAB) Write a MATLAB program to compute and plot the 
ten-term approximations to cos8 and sinO for 6 running from to 
2 (2ir) in steps of 27r/50. Compute and overplot exact expressions 
for cosO and sin9. You should observe a result like Figure 2.4. 

The Unit Circle. The unit circle is defined to be the set of all complex 
numbers z whose magnitudes are 1. This means that all the numbers on 
the unit circle may be written as z = e^ e . We say that the unit circle 
consists of all numbers generated by the function z = e^ 9 as 9 varies from 
to 2tt. See Figure 2.6. 

A Fundamental Symmetry. Let's consider the two complex num- 
bers zi and \, illustrated in Figure 2.6. We call \the "reflection of 

z through the unit circle" (and vice versa). Note that z\ = rie^ 1 and 






The complex numbers z\ — e^ e and 



°J e are illustrated 



in Figure 2.6. The magnitude squared of each is 



\z 1 - e 



JS\2 



| 2 = ( Zl - e*) (zl - e~") 



J°\2 



r/jO 



-JO 



Zl 



The ratio of these magnitudes squared is 

( Zl -e>°)(zt-e-») 



P 



e' 1 



a 



e-i ( 
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(2.29) 
(2.30) 

(2.31) 



This ratio may be manipulated to show that it is independent of 9, 
meaning that the points z\ and \ maintain a constant relative distance 
from every point on the unit circle: 



ft 2 



e je (e- je z 1 -l)(z*e je -l)e- j ' 

| z\ | 2 , independent of#! 



(2.32) 



This result will be of paramount importance to you when you study 
digital filtering, antenna design, and communication theory. 




unit circle 



Figure 2.6: The Unit Circle 
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Exercise 2.7 

Write the complex number z — e? e as re^. What are r and cf>? 



2.4 The Functions e~x and e~j<9: The Euler 
and De Moivre Identities 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The Euler and De Moivre identities are the fundamental identities for 
deriving trigonometric formulas. From the identity e^ = cosO + jsinO 
and the conjugate identity e~i e = (e^ 9 ) = cosO — jsinO, we have the 
Euler identities for cos9 and sinO: 



cost) 
sind 



e 3» +e -3» 

j. l-i. ( 2 - 33 ) 



2j 

These identities are illustrated in Figure 2.7. 



5 This content is available online at <http://cnx.Org/content/m21487/l.6/>. 
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pjO_ e -jO 




Figure 2.7: Euler's Identities 



The identity &> = cosO + jsinO also produces the De Moivre identity: 

(2.34) 



{cose + j sin 6) n = (e ie ) = e^ 9 
= cosnd + jsinnO 



When the left-hand side of this equation is expanded with the binomial 
expansion, we obtain the identity 



E 

k=0 



i—k / ■ ■ n \k 



k 



(cosO) (jsin9) = cosnd + jsinnd. (2.35) 



Binomial Coefficients and Pascal's Triangle. The binomial coeffi- 
cients (£) in (2.35) are shorthand for the number 



n \ n\ 

I, I = {n-k){kV fc = ' 1 ' 



(2.36) 



This number gives the coefficient of x n ~ h y k in the expansion of (a; + y) n . 
How do we know that there are (£) terms of the form x n ~ k y k ? One way to 
answer this question is to use Pascal's triangle, illustrated in Figure 2.8. 
Each node on Pascal's triangle shows the number of routes that terminate 
at that node. This number is always the sum of the number of routes that 
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terminate at the nodes just above the node in question. If we think of 
a left-hand path as an occurrence of an x and a right-hand path as an 
occurrence of a y, then we see that Pascal's triangle keeps track of the 
number of occurrences of x n ~ k y k . 




Figure 2.8: Pascal's Triangle and the Binomial Coefficients 



Exercise 2.8 

Prove («) = («_ fe ). 

Exercise 2.9 

Find an identity for (£"J) + (^_ 1 ). 

Exercise 2.10 

Find "half-angle" formulas for cos29 and sin20. 

Exercise 2.11 

Show that 

A. cos36 = cos 2 9 — 3cos6 sin 2 8; 

B. sinW = 34cos 2 6sin6 — sin 9. 

Exercise 2.12 

Use e j ^ 1+02) = e j6l e j62 = {cosd x + jsinOx) {cos8 2 + jsin8 2 ) to 
prove 

a. cos (#i + 82) = cos8\cos82sin8\sin8i ; 

b. sin (8\ + 82) = sin8\Cos&2 + sin82Cos8\. 
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2.5 The Functions e~x and e~j#: Roots of 
Unity and Related Topics 6 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The complex number z = e j27r / JV is illustrated in Figure 2.9. It lies on 
the unit circle at angle 9 = 2tt/N. When this number is raised to the 
n th power, the result is z n = e j27r "/ Jv . This number is also illustrated in 
Figure 2.9. When one of the complex numbers e j2 ' m / JV is raised to the 
N th power, the result is 

\ N 



6 This content is available online at <http://cnx.Org/content/m21482/l.7/>. 



58 



CHAPTER 2. THE FUNCTIONS E~X AND 

E~JQ 



UJ2-Kn/N\N _ e J2ivn _ ^ 



J27in/N 



2 k /N 




Figure 2.9: The Complex Numbers e ]27T/N and e j27vn/N 



We say that e^" 1 /* is one of the N th roots of unity, meaning that 
e j27m/N - m one f |. ne vames f z f or w hich 

z N - 1 = 0. (2.38) 

There are JV such roots, namely, 

e j27m/A \ n = 0,l,...,JV-l. (2.39) 

As illustrated in Figure 2.10, the 12" 1 roots of unity are uniformly dis- 
tributed around the unit circle at angles 27rn/12. The sum of all of the 
N th roots of unity is zero: 



N-l 



Sn=Y. 



j2im/N 



0. 



(2.40) 



n=0 



This property, which is obvious from Figure 2.10, is illustrated in Fig- 
ure 2.11, where the partial sums Sk = E n =o e 32 ™^ are plotted for 
k = l,2,...,N. 
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i 2k 3 / 1 2 



j 2?r 4 / 1 2 



j2;r2/12 




Figure 2.10: Roots of Unity 



These partial sums will become important to us in our study of phasors 
and light diffraction in "Phasors" (Section 3.1) and in our discussion of 
filters in "Filtering" (Section 6.1). 
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' 



Figure 2.11: Partial Sums of the Roots of Unity 



Geometric Sum Formula. It is natural to ask whether there is an 
analytical expression for the partial sums of roots of unity: 



n=0 



(2.41) 



We can imbed this question in the more general question, is there an 
analytical solution for the "geometric sum" 



fc-i 



s k = J2 z " 



(2.42) 



The answer is yes, and here is how we find it. If z = 1, the answer is 
Sk = k. If z =£ 1, we can premultiply Sk by z and proceed as follows: 



O _ TT^k-1 n+ l _ y,fc r 

= EjTio^ + ^-i 

S fc + z fc -l. 



(2.43) 
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From this formula we solve for the geometric sum: 



'"** z±\ 



S k = { X ~ z ' (2.44) 

k, z = 1. 

This basic formula for the geometric sum Sk is used throughout electro- 
magnetic theory and system theory to solve problems in antenna design 
and spectrum analysis. Never forget it. 

Exercise 2.13 

Find formulas for S k = £^o e J " e and for S k = £^o e j2w / Nn . 
Exercise 2.14 

Prove E^Jo 1 el2 ™ /N = 0- 
Exercise 2.15 

Find formulas for the magnitude and phase of the partial sum 

S k = T l k n -J e i2wn/N - 
Exercise 2.16 

(MATLAB) Write a MATLAB program to compute and plot 
the partial sum S k = Y,n=l e j27Tn/N for k = 1,2,..., N. You 
should observe Figure 2.11. 

Exercise 2.17 

Solve the equation (z + 1) = z 3 . 

Exercise 2.18 

Find all roots of the equation z 3 + z 2 + 3z — 15 = 0. 

Exercise 2.19 

Find cso that (1 + j) is a root of the equation z 17 + 2z 15 — c = 0. 



2.6 The Functions e~x and e~j(9: Second-Order 
Differential and Difference Equations 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



7 This content is available online at <http://cnx.Org/content/m21483/l.7/>. 
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With our understanding of the functions e x , e^ 6 , and the quadratic equa- 
tion z 2 + -z+ - = 0, we can undertake a rudimentary study of differential 
and difference equations. 

Differential Equations. In your study of circuits and systems you 
will encounter the homogeneous differential equation 

-^x{t) + ai —x{t) + a 2 = 0. (2.45) 

Because the function e st reproduces itself under differentiation, it is plau- 
sible to assume that x (t) = e st is a solution to the differential equation. 
Let's try it: 

(s 2 + a 1 s + a 2 ) e st = 0. 

If this equation is to be satisfied for all t, then the polynomial in s must 
be zero. Therefore we require 

s 2 + ais + a 2 = 0. (2.47) 

As we know from our study of this quadratic equation, the solutions are 

s 1 ,2 = ~±\^a 2 -Aa 2 . (2.48) 

This means that our assumed solution works, provided s = s\ or s 2 . It 
is a fundamental result from the theory of differential equations that the 
most general solution for x (t) is a linear combination of these assumed 
solutions: 

x (t) = A ie Slt + A 2 e S2t . (2.49) 

If a 2 — 4a 2 is less than zero, then the roots si and s 2 are complex: 

s h2 = -^±j^4a 2 -a 2 . (2.50) 

Let's rewrite this solution as 

Sl,2 = cr ± ju> (2-51) 

where a and u> are the constants 

t = ~Y ( 2 - 52 ) 



u,' = -^i^-aj. 



With this notation, the solution for x (t) is 
x (t) = A x e at e iujt + A 2 e a 



t„—jtut 
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(2.53) 



(2.54) 



If this solution is to be real, then the two terms on the right-hand side 
must be complex conjugates. This means that A 2 = A\ and the solution 
for x (t) is 



x(t) = Aie°V wt + A* 1 e' Tt e~ JuJt 
2Re{A 1 e' rt e jut }. 



(2.55) 



The constant A\ may be written as A\ = |A|e J '^. Then the solution for 

x (t) is 

x (t) = 2\A\e Jt cos{ujt + </>). (2.56) 

This "damped cosinusoidal solution" is illustrated in Figure 2.12. 




Figure 2.12: The Solution to a Second-Order Differential Equa- 
tion 
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Exercise 2.20 

Find the general solutions to the following differential equations: 

a. jLx(t) + 2J- t x{t) + 2 = Q; 

b. ^x(t) + 2f t x(t)-2 = 0; 

c. £x(t) + 2 = 0. 

Difference Equations. In your study of digital filters you will encounter 
homogeneous difference equations of the form 

x n + a 1 x n -i + a 2 x n ^ 2 = Q. ( 2 - 57 ) 

What this means is that the sequence{x n } obeys a homogeneous recur- 
sion: 

x n = -aiXn-i ~ a 2 x n -2- (2.58) 

A plausible guess at a solution is the geometric sequence x n = z n . With 
this guess, the difference equation produces the result 

z n + a-tz" 1 - 1 + a 2 z n - 2 = 

(2.59) 
(l + axz" 1 + a 2 z~ 2 ) z n = 0. 

If this guess is to work, then the second-order polynomial on the left-hand 
side must equal zero: 

1 + a\z~ x + a 2 z~ 2 = 

1 + a\z~ l + a 2 z~ 2 = 

(2.60) 
z 2 + a\Z + a 2 = 0. 

The solutions are 



Zi,2 = -^±jy±a 2 -a\ 

= re je . 

The general solution to the difference equation is a linear combination of 
the assumed solutions: 

x n = A lZ ? + A 2 {zl) n 

= A lZ ? + At(z$) n 

(2.62) 

2Re{A lZ ?} 

= 2\A\r n cos(0n + 4>). 
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This general solution is illustrated in Figure 2.13. 
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Figure 2.13: The Solution to a Second-Order Difference Equation 



Exercise 2.21 

Find the general solutions to the following difference equations: 

a. x n + 2x n -\ + 2 = 0; 

b. x n — 2x n _ 1 + 2 = 0; 

c. x n + 2:r„_2 = 0. 



2.7 The Functions e~x and e~j#: Numerical 
Experiment (Approximating e~j#) 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



3 This content is available online at <http://cnx.Org/content/m21481/l.7/>. 
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We have demonstrated that the function e jS has two representations: 



1. e je = Urn (l + J -Y 

z - e -„'!!^^fe=o fci 



and 



In this experiment, you will write a MATLAB program to evaluate the 
two functions f n and S n for twenty values of n: 



1- fn= (l+f)",n=l,2,...,20;and 



Choose = 7r/4 (= pi/4). Use an implicit for loop to draw and plot a 
circle of radius 1. Then use an implicit for loop to compute and plot /„ 
and an explicit for loop to compute and plot S n for n = 1,2, ..., 100. You 
should observe plots like those illustrated in Figure 2.14. Interpret them. 
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Chapter 3 
Phasors 



3.1 Phasors: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



3.1.1 Notes to Teachers and Students: 

Phasors! For those who understand them, they are of incomparable value 
for the study of elementary and advanced topics. For those who mis- 
understand them, they are a constant source of confusion and are of no 
apparent use. So, let's understand them. 

The conceptual leap from the complex number e^ 6 to the phasor 
e j(uit+e) comes m "Phasor Representation of Signals" (Section 3.2). Take 
as long as necessary to understand every geometrical and algebraic nu- 
ance. Write the MATLAB program in "Exercise 6" (Exercise 3.6) to 
fix the key ideas once and for all. Then use phasors to study beating 
between tones, multiphase power, and Lissajous figures in "Beating be- 
tween Tones" (Section 3.3) through "Lissajous Figures" (Section 3.5). We 
usually conduct a classroom demonstration of beating between tones us- 
ing two phase-locked sources, an oscilloscope, and a speaker. We also 
demonstrate Lissajous figures with this hardware. 



lr This content is available online at <http://cnx.Org/content/m21469/l.6/>. 
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"Sinusoidal Steady State and the Series RLC Circuit" (Section 3.6) 
and Light Scattering by a Slit" (Section 3.7) on sinusoidal steady state 
and light scattering are too demanding for freshmen but are right on 
target for sophomores. These sections may be covered in a sophomore 
course (or a supplement to a sophomore course) or skipped in a freshman 
course without consequence. 

In the numerical experiment in "Numerical Experiment (Interference 
Patterns)" (Section 3.8), students compute and plot interference patterns 
for two sinusoids that are out of phase. 

3.1.2 Introduction 

In engineering and applied science, three test signals form the basis for our 
study of electrical and mechanical systems. The impulse is an idealized 
signal that models very short excitations (like current pulses, hammer 
blows, pile drives, and light flashes). The step is an idealized signal that 
models excitations that are switched on and stay on (like current in a re- 
lay that closes or a transistor that switches) . The sinusoid is an idealized 
signal that models excitations that oscillate with a regular frequency (like 
AC power, AM radio, pure musical tones, and harmonic vibrations). All 
three signals are used in the laboratory to design and analyze electrical 
and mechanical circuits, control systems, radio antennas, and the like. 
The sinusoidal signal is particularly important because it may be used to 
determine the frequency selectivity of a circuit (like a superheterodyne 
radio receiver) to excitations of different frequencies. For this reason, ev- 
ery manufacturer of electronics test equipment builds sinusoidal oscillators 
that may be swept through many octaves of Orequency. (Hewlett-Packard 
was started in 1940 with the famous HP audio oscillator.) 

In this chapter we use what we have learned about complex numbers 
and the function e^ e to develop a phasor calculus for representing and ma- 
nipulating sinusoids. This calculus operates very much like the calculus 
we developed in "Complex Numbers" (Section 1.1) and "The Functions 
e x and e> e " (Section 2.1) for manipulating complex numbers. We ap- ply 
our calculus to the study of beating phenomena, multiphase power, series 
RLC circuits, and light scattering by a slit. 

3.2 Phasors: Phasor Representation of Signals 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 



2 This content is available online at <http://cnx.Org/content/m21474/l.7/>. 
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for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

There are two key ideas behind the phasor representation of a signal: 

i. a real, time-varying signal may be represented by a complex, time- 
varying signal; and 

ii. a complex, time-varying signal may be represented as the product 
of a complex number that is independent of time and a complex 
signal that is dependent on time. 

Let's be concrete. The signal 

x (t) = Acos (cot + <f>) , (3.1) 

illustrated in Figure 3.1, is a cosinusoidal signal with amplitude A, fre- 
quency u>, and phase <j>. The amplitude A characterizes the peak-to-peak 
swing of 2A, the angular frequency u> characterizes the period T = — 
between negative- to-positive zero crossings (or positive peaks or negative 
peaks), and the phase </> characterizes the time r = — when the signal 
reaches its first peak. With r so defined, the signal x (t) may also be 
written as 

x (t) = Acosco (t - t) . (3.2) 
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A cos(COt*<p ) versus t 



Figure 3.1: A Cosinusoidal Signal 



When r is positive, then r is a "time delay" that describes the time 
(greater than zero) when the first peak is achieved. When r is negative, 
then r is a "time advance" that describes the time (less than zero) when 
the last peak was achieved. With the substitution u> 
third way of writing x (t): 



^r we obtain a 



x(t) 



2tt . 
Acos— (t 



(3.3) 



In this form the signal is easy to plot. Simply draw a cosinusoidal wave 
with amplitude A and period T; then strike the origin (t = 0) so that the 
signal reaches its peak at r. In summary, the parameters that determine 
a cosinusoidal signal have the following units: 

A, arbitrary (e.g., volts or meters/sec, depending upon the applica- 
tion) 

io, in radians/sec (rad/sec) 

T, in seconds (sec) 

<j>, in radians (rad) 

t, in seconds (sec) 

Exercise 3.1 

Show that x (t) = Acos^- (t — t) is "periodic with period T," 
meaning that x (t + mT) = x (t) for all integer m. 
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Exercise 3.2 

The inverse of the period T is called the "temporal frequency" 
of the cosinusoidal signal and is given the symbol /; the units 
of / = ^ are (seconds) - or hertz (Hz). Write x (t) in terms of 
/. How is / related to w? Explain why / gives the number of 
cycles of x (t) per second. 

Exercise 3.3 

Sketch the function x(t) = llOcos [2tt (60) t - f] ver- 
sus t. Repeat for x (t) = 5cos [2ir (16 x 10 6 ) t + f ] and 

x (t) = 2cos y|?3 1 t — i^— ) . For each function, determine 

A, ui, T, f, <fi, and r. Label your sketches carefully. 

The signal x (t) = Acos (cot + <f>) can be represented as the real part of a 
complex number: 

x (t) = Re \Ae j ^ t+ ^] 
W L J (3.4) 

= Re [Ae^e^] . 
We call Ae^e-'"' the complex representation of x (t) and write 

x(i)^Ae j4 'e jut , (3.5) 

meaning that the signal x (t) may be reconstructed by taking the real part 
of Ae?^e? wt . In this representation, we call Ae^ the phasor or complex 
amplitude representation of x (t) and write 

x(t)^,Ae^, (3.6) 

meaning that the signal x (t) may be reconstructed from Ae?^ by multi- 
plying with e JW ' and taking the real part. In communication theory, we 
call Ae^ the baseband representation of the signal x(i). 

Exercise 3.4 

For each of the signals in Problem 3.3, give the corresponding 
phasor representation Ae?^ . 

Geometric Interpretation. Let's call 

Ae j4, e juJt (3.7) 

the complex representation of the real signal Acos (tot + </>). At t = 0, 
the complex representation produces the phasor 

At?*. (3.8) 
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This phasor is illustrated in Figure 3.2. In the figure, cf> is approximately 
^ If we let t increase to time t\, then the complex representation pro- 
duces the phasor 



Ae^e 3 """'. 







••-Ae^e^'i Ct- *,) 



i ;A (t--*to) 



7Ae^ (£=o) 



--- ^'AeJ'V '^ U»£J 



Figure 3.2: Rotating Phasor 



We know from our study of complex numbers that e- 7 "* 1 just rotates 
the phasor Ae^ through an angle of utti ! See Figure 3.2. Therefore, 
as we run t from 0, indefinitely, we rotate the phasor Ae>^ indefinitely, 
turning out the circular trajectory of Figure 3.2. When t = — then 
e jut _ e j2n _ ^ Therefore, every (— ) seconds, the phasor revisits any 
given position on the circle of radius A. We sometimes call Ae^e^ 1 a 
rotating phasor whose rotation rate is the frequency ui: 



dt 



-ujt 



(3.9) 



This rotation rate is also the frequency of the cosinusoidal signal 
Acos {ut + <f>). 

In summary, Ae^e 3 "' is the complex, or rotating phasor, representa- 
tion of the signal Acos (uit + </>). In this representation, e? ut rotates the 
phasor Ae^ through angles iot at the rate to. The real part of the com- 
plex representation is the desired signal Acos (lot + <fi). This real part is 
read off the rotating phasor diagram as illustrated in Figure 3.3. In the 
figure, the angle (p is about — f?- As we become more facile with phasor 
representations, we will write x (t) = Re [Xe 3 '"'] and call Ie J1Jt the com- 
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plex representation and X the phasor representation. The phasor X is, 
of course, just the phasor Ae?^ . 



Ae jp ei 0i 




Figure 3.3: Reading a Real Signal from a Complex, Rotating 
Phasor 



Exercise 3.5 

Sketch the imaginary part of Ae^e'' JJt to show that this is 
Asin (uit + <j>) . What do we mean when we say that the real 
and imaginary parts of Ae^e^' are "90° out of phase"? 

Exercise 3.6 

(MATLAB) Modify Demo 2.1 in "The Function e x and ei e " 
(Section 2.1) so that 8 = cut, with u> an input frequency variable 
and t a time variable that ranges from — 2(^)io + 2(^) in 
steps of 0.02 ( — ). In your modified program, compute and 
plot e ja, *,Re [e jut ], and Im [e juJt ] for -2 (^) < t < 2 (^) in 
steps of 0.02 (— )• Plot e Ja,t in a two-dimensional plot to get a 
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picture like Figure 3.2 and plot Re [e J ' w *] and Im [e 3UJt ~\ versus 
t to get signals like those of Figure 3.1. You should observe 
something like Figure 3.4 using the subplot features discussed 
in An Introduction to MATLAB (Section 8.1). (In the figure, w 
represents Greek w.) 



exp(jwt) 



1 1 

Real 



Re { exp(jwt) } and Im ( exp(jwt) ) vs t w m 1 000*2*p i 



-2 



-1.5 



-0.5 





Time 



0.5 



1.5 2 

xlO-3 



Figure 3.4: The Functions e jwt , Re [e JtJ 'l , and Im [e J ""l 



Positive and Negative Frequencies. There is an alternative pha- 
sor representation for the signal x (t) = Acos(cjt + <f>). We obtain it by 
using the Euler formula of "The Function e x s-> e " (Section 2.1), namely, 
cos 8 = \ {e> s + e~i 6 ). When this formula is applied to x (t), we obtain 
the result 



x(t) 



A e J4> e 3^t 






2 e 



(3.10) 
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In this formula, the term ^e^e^ ut is a rotating phasor that begins at 
the phasor value Ae^ (for t = 0) and rotates counterclockwise with fre- 
quency u>. The term ^e~^e~^ ojt is a rotating phasor that begins at the 
(complex conjugate) phasor value ^e~^ (for t = 0) and rotates clock- 
wise with (negative) frequency uj. The physically meaningful frequency 
for a cosine is u>, a positive number like 2ir (60) for 60 Hz power. There is 
no such thing as a negative frequency. The so-called negative frequency 
of the term ^e^^e - - 7 "* just indicates that the direction of rotation for 
the rotating phasor is clock-wise and not counterclockwise. The notion 
of a negative frequency is just an artifact of the two-phasor representa- 
tion of Acos (cot + </>). In the one-phasor representation, when we take the 
"real part," the artifact does not arise. In your study of circuits, systems 
theory, electromagnetics, solid-state devices, signal processing, control, 
and communications, you will encounter both the one- and two-phasor 
representations. Become facile with them. 

Exercise 3.7 

Sketch the two-phasor representation of Acos (uit + <f>). Show 
clearly how this representation works by discussing the counter- 
clockwise rotation of the positive frequency part and the clock- 
wise rotation of the negative frequency part. 

Adding Phasors. The sum of two signals with common frequencies but 
different amplitudes and phases is 

A x cos (cut + fa) + A 2 cos {ujt + 4> 2 ) ■ (3-11) 

The rotating phasor representation for this sum is 

(A 1 e j4 ' 1 +A 2 e j ' t ' 2 )e jut . (3.12) 

The new phasor is Aie^ 1 + A 2 e^ 2 , and the corresponding real signal 
is x{t) = Re [(Aie^ 1 + A 2 e j ' 1 " 2 ) e jut ]. The new phasor is illustrated in 
Figure 3.5. 
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Figure 3.5: Adding Phasors 



Exercise 3.8 

Write the phasor A^^ 1 + A 2 e^ 2 as A z e^ z ; determine A 3 and 
03 in terms of Ai,A2,<j>i, and <f>2- What is the corresponding 
real signal? 

Differentiating and Integrating Phasors. The derivative of the signal 
Acos (tut + (f>) is the signal 



j- t A cos (cot + <f>) 



—wAsin (cot + 4>) 

-Im [ujAe^e^] 

Re [jwAe^e jwt ] 

Re luje^^Ae^e^] 



(3.13) 



This finding is very important. It says that the derivative of Acos [tot + <f>) 
has the phasor representation 



Acos {ut + </>) 



jujAe^ 
uje^/ 2 Ae^. 



(3.14) 



These two phasor representations are entirely equivalent. The first says 
that the phasor Ae^ is complex scaled by jto to produce the phasor for 
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-jjAcos (u>t+(p, and the second says that it is scaled by u> and phased by 
+7r/2. The phasor representations of Acos (tot + (/>) and -^Acos (tot + 4>) 
are illustrated in Figure 3.6. Note that the derivative "leads by tt/2 radians 
(90)." 



w 



e ]n,2 Aei 




L e -3*'2 Ae 3* 



Figure 3.6: Differentiating and Integrating Phasors 



The integral of Acos (tot + 4>) is 
J Acos (cot + 4>) dt = 



— sin (tot + (j)) 

Im [£e J '<V wt ] 

Re {-j^e^e^} 

Re [j^e^e^*! 

Re l^-e-^^Ae^eJ^] 



This finding shows that the integral of Acos (cot 
representation 



(3.15) 



has the phasor 



/ Acos (cot + 4>) dt 



-e-^^Ae^. 



(3.16) 
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The phasor Ae^ is complex scaled by J- or scaled by — and phased by 
g-i^/2 ^ produce the phasor for J Acos (cot + <fi) dt. This is illustrated in 
Figure 3.6. Note that the integral "lags by ir/2 radians (90). Keep these 
geometrical pictures of leading and lagging by 7r/2 in your mind at all 
times as you continue your more advanced study of engineering. 

An Aside: The Harmonic Oscillator. The signal Acos (cot + (j>) 
stands on its own as an interesting signal. But the fact that it reproduces 
itself (with scaling and phasing) under differentiation means that it obeys 
the second-order differential equation of the simple harmonic oscillator. 3 
That is, the differential equation 



d 2 x (t) 
dt 2 



+ u> 2 x(t) = (3.17) 



has the solution 

x (t) = Acos (cot + 4>) . (3.18) 

Try it: 

d 2 d 

-—x (t) = — [-Acosin (cot + </>)] = -J 1 Acos (cot + 4>) . (3.19) 

dt/ dt 

The constants A and <f> are determined from the initial conditions 

x (0) = Acos4> x 2 (0) + x 2 (£) = A 2 

O (3.20) 

X {iz) = - Asin( t > ~ x( lS) ] = tan< t>- 

Exercise 3.9 

Show how to compute A and <fi m the equation x (t) = 
Acos (cot + <f)) from the initial conditions x (O) and -^x (t) \ t=0 - 



3.3 Phasors: Beating between Tones 4 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 



3 This means, also, that we have an easy way to synthesize cosines with circuits that 
obey the equation of a simple harmonic oscillator! 

4 This content is available online at <http://cnx.org/content/m21468/!. 6/>. 
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for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Perhaps you have heard two slightly mistuned musical instruments play 
pure tones whose frequencies are close but not equal. If so, you have 
sensed a beating phenomenon wherein a pure tone seems to wax and 
wane. This waxing and waning tone is, in fact, a tone whose frequency 
is the average of the two mismatched frequencies, amplitude modulated 
by a tone whose "beat" frequency is half the difference between the two 
mismatched frequencies. The effect is illustrated in Figure 3.7. Let's see 
if we can derive a mathematical model for the beating of tones. 

We begin with two pure tones whose frequencies are ujq + v and uj q — v 
(for example, uiq = 2ir x 10 3 rad/sec and v = 2irrad/ sec). The average 
frequency is u>g, and the difference frequency is 2v. What you hear is the 
sum of the two tones: 

x (t) = A 1 cos [(w + v) t + 4>x] + A 2 cos [(w - v) t + <j> 2 ] ■ (3.21) 

The first tone has amplitude A\ and phase <fii ; the second has amplitude 
A 2 and phase <j> 2 . We will assume that the two amplitudes are equal to 
A. Furthermore, whatever the phases, we may write them as 

^1 = ^ + ^ and 2 = </>-?/, 

4> = \ (<Ai + fo) and ip = § (0i - fa) ■ 
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Figure 3.7: Beating between Tones 



Recall our trick for representing x (t) as a complex phasor: 

x(t) = ARe{e^'- ul0+ ^ t+ 't ,+ ^,+,e j ^«-^ t+ ' t '-^} 
= ARe{e j ^° t+4 '\ [e^ vt+ ^ + e -J'("*+V0] } 

2A Re{e^ * +<A \ cos, (vt + ip)} 
= 2 A cos (coot + <f>) cos {vt + ip) . 



(3.23) 



This is an amplitude modulated wave, wherein a low frequency signal 
with beat frequency v rad/sec modulates a high frequency signal with 
carrier frequency luo rad/sec. Over short periods of time, the modulat- 
ing term cos(i>t+ip remains essentially constant while the carrier term 
cos (iVot + 4>) turns out many cycles of its tone. For example, if t runs 
from to jjj;; (about 0.1 seconds in our example), then the modulating 
wave turns out just 1/10 cycle while the carrier turns out WPuj^ cycles 
(about 100 in our example). Every time vt changes by 27r radians, then 
the modulating term goes from a maximum (a wax) through a minimum 
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(a wane) and back to a maximum. This cycle takes 

v t = 2ir<^t = — seconds, (3.24) 

which is 1 second in our example. In this 1 second the carrier turns out 
1000 cycles. 

Exercise 3.10 

Find out the frequency of A above middle C on a piano. Assume 
two pianos are mistuned by ±lHz (±27rrad/sec). Find their beat 
frequency v and their carrier frequency uiq. 

Exercise 3.11 

(MATLAB) Write a MATLAB program to compute and plot 

Acos [(wo + v) t + 4>i] , A cos [(wo — v) t + fo], and their sum. 
Then compute and plot lAcos (u>ot + 4>) cos (yt + ip). 
Verify that the sum equals this latter signal. 



3.4 Phasors: Multiphase Power 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The electrical service to your home is a two-phase service. 6 This means 
that two 110 volt, 60 Hz lines, plus neutral, terminate in the panel. The 
lines are n radians (180) out of phase, so we can write them as 



xi(t) = 110 cos [2vr (60) t + <f>] = RejllOe-'^ 60 )*^]} 

(3.2a)i = 
Re{X ie ^( 6 °)'} 

j(j> x 2 {t) = 110 cos [2tt (60) £ + + tt] = Re{110e^( 60 ) t+< ^} 
Re{X 2 e^ 6 °)'} 

110e^+^. 



5 This content is available online at <http://cnx.Org/content/m21472/l.6/>. 

6 It really is, although it is said to be "single phase" because of the way it is picked 
off a single phase of a primary source. You will hear more about this in circuits and 
power courses. 
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These two voltages are illustrated as the phasors Xj and X2 in Fig- 
ure 3.8. 




Figure 3.8: Phasors in Two-Phase Power 



You may use x\ (t) to drive your clock radio or your toaster and the 
difference between x\ (t) and x 2 (t) to drive your range or dryer: 

xi (t) - x 2 (t) = 220cos [2ir (60) t + </>] . (3.26) 

The phasor representation of this difference is 

X 1 -X 2 = 220e^. (3.27) 

The breakers in a breaker box span the X\- to-neutral bus for 110 volts 
and the x\-^o-x 2 buses for 220 volts. 

Exercise 3.12 

Sketch the phasor X\ — X 2 on Figure 3.8. 

Most industrial installations use a three-phase service con- 
sisting of the signals x\ (t) , x 2 (t), and X3 (t): 



x n (t) = 110Re{e' 



j[u> t+n(2n/3)] 



}^X n 



110e 



jn(2ir/3) 



= 1,2,3. 

(3.28) 
The phasors for three-phase power are illustrated in Figure 3.9. 

Exercise 3.13 

Sketch the phasor X 2 — X\ corresponding to x 2 (t) — x\ (t) on 
Exercise 3.14. Compute the voltage you can get with x 2 (t) — 
x\ (t). This answer explains why you do not get 220 volts in 
three-phase circuits. What do you get? 
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Figure 3.9: Three-Phase Power 



Constant Power. Two- and three-phase power generalizes in an 
obvious way to N-phase power. In such a scheme, the N signals 
x n (n =0, 1, ...,N — 1) are 



x n (t) 



Acos [wt 



N ' 



= Re [Ae j27rn / N 'e joJt ] <-> X n = Ae^ n ' N . 
The phasors X n are Ae : ' 2 ' K ^ n ' N ' . The sum of all N signals is zero: 



(3.29) 



N-l 

£ 

n=0 



v — i 



Re{A T 



0. 



} 



(3.30) 



But what about the sum of the instantaneous powers? Define the instan- 
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taneous power of the n th signal to be 

p n (t) = x 2 n (t) = A 2 cos 2 (tot + % n) 

= ^-+^-cos(2cot + 2^n) (3.31) 

The sum of all instantaneous powers is (see Exercise 3.14) 

N ~ 1 A2 

p=^2 Pn (t) = N—, (3 - 32) 

n=0 

and this is independent of time! 

Exercise 3.14 

Carry out the computations of Equation 3.33 to prove that 
instantaneous power P is constant in the N-phase power scheme. 



3.5 Phasors: Lissajous Figures 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Lissajous figures are figures that are turned out on the face of an oscil- 
loscope when sinusoidal signals with different amplitudes and different 
phases are applied to the time base (real axis) and deflection plate (imag- 
inary axis) of the scope. The electron beam that strikes the phosphorous 
face then had position 

z (t) = A x cos (ut + 4> x ) + jAyCos (cot + cj> y ) . (3.33) 

In this representation, A x cos (cut + <f> x ) is the "x-coordinate of the point," 
and A y cos (uit + <fi) is the "y-coordinate of the point." As time runs from 
to infinity, the point z (t) turns out a trajectory like that of Figure 3.10. 
The figure keeps overwriting itself because z (t) repeats itself every — 
seconds. Do you see why? 



7 This content is available online at <http://cnx.Org/content/m21471/l.6/>. 
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Figure 3.10: Lissajous Figure on Oscilloscope Screen 



Exercise 3.15 

Find the intercepts that the Lissajous figure makes with the 
real and imaginary axes in Figure 3.10. At what values of time 
are these intercepts made? 

Exercise 3.16 

Show that the Lissajous figure z (t) = 

A x cos(u>t + <f> x ) +jA y cos(ojt + <j>y) is just the rotating phasor 



Ae j(u,t+4>) when a x = A v = A, 



and 



Two-Phasor Representation. We gain insight into the shape of the 
Lissajous figure if we use Euler's formulas to write z (t) as follows: 



z(t) 



4t ry(wH>x) + e -j(wt+^,)j + ( 3 _ 34 ) 



-j((jt + (j>y) 



A x ei^+jA y e 



■3<t>y 



oJUt 



A x e 



-3<t>a 



+jA v e-i<t>v 



-juit 



This representation is illustrated in Figure 3.11. It consists of two 
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rotating phasors, with respective phasors B\ and Bi : 



z (t) = Bxe^t + B 2 e 



B 
B 2 



-jut 



2 
A x e- i4 "^+jA v e- 



J4>y 



(3.35) 



J 2 




Figure 3.11: Two-Phasor Representation of a Lissajous Figure 



As t increases, the phasors rotate past each other where they con- 
structively add to produce large excursions of z (t) from the origin, and 
then they rotate to antipodal positions where they destructively add to 
produce near approaches of z (t) to the origin. 

In electromagnetics and optics, the representations of z (t) given in 
(3.33) and (3.35) are called, respectively, linear and circular representa- 
tions of elliptical polarization. In the linear representation, the x- and 
y-components of z vary along the horizontal and vertical lines. In the 
circular representation, two phasors rotate in opposite directions to turn 
out circular trajectories whose sum produces the same effect. 



Exercise 3.17 

(MATLAB) Write a MATLAB program to compute and plot 
the Lissajous figure z(t) when A x = 1/2, A y = l,<f> x = 0, and 
<j) y = 7r/6. Discretize t appropriately and choose an appropriate 
range of values for t. 



3.6 Phasors: Sinusoidal Steady State and the 
Series RLC Circuit 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Phasors may be used to analyze the behavior of electrical and mechanical 
systems that have reached a kind of equilibrium called sinusoidal steady 
state. In the sinusoidal steady state, every voltage and current (or force 
and velocity) in a system is sinusoidal with angular frequency u>. However, 
the amplitudes and phases of these sinusoidal voltages and currents are 
all different. For example, the voltage across a resistor might lead the 
voltage across a capacitor by 90° ( | radians) and lag the voltage across 
an inductor by 90° {^radians). 

In order to make our application of phasors to electrical systems con- 
crete, we consider the series RLC circuit illustrated in Figure 3.12. The 
arrow labeled i (t) denotes a current that flows in response to the voltage 
applied, and the + and - on the voltage source indicate that the polarity 
of the applied voltage is positive on the top and negative on the bottom. 
Our convention is that current flows from positive to negative, in this case 
clockwise in the circuit. 



3 This content is available online at <http://cnx.Org/content/m21475/l.6/>. 
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Figure 3.12: Series RLC Circuit 



We will assume that the voltage source is an audio oscillator that pro- 
duces the voltage 



V (t) = Acos (ut + (j)) . 
We represent this voltage as the complex signal 

V (t) <-» Ae^e 3 ^ 
and give it the phasor representation 



V(i) ~V;V = Ae 



3<i> 



(3.36) 
(3.37) 
(3.38) 



We then describe the voltage source by the phasor V and remember that 
we can always compute the actual voltage by multiplying by e* ut and 
taking the real part: 



V{t) = Re{Ve : > LJt }. 



(3.39) 



Exercise 3.18 

Show that Re [VeJ^] = Acos {ut + (f>) when V = Ae 3 *. 

Circuit Laws. In your circuits classes you will study the Kirchhoff laws 
that govern the low frequency behavior of circuits built from resistors 
(R), inductors (L), and capacitors (C). In your study you will learn that 
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the voltage dropped across a resistor is related to the current that flows 
through it by the equation 

V R (t) = Ri (t) . (3.40) 

You will learn that the voltage dropped across an inductor is proportional 
to the derivative of the current that flows through it, and the voltage 
dropped across a capacitor is proportional to the integral of the current 
that flows through it: 

V '' W = 1 « W (3.41) 

Vc(t) = h /*(')*• 

Phasors and Complex Impedance. Now suppose that the current in 
the preceding equations is sinusoidal, of the form 

i (t) = B cos (u>t + 6) . (3.42) 

We may rewrite i (t) as 

i (t) = Re{Ie jwt } (3.43) 

where / is the phasor representation of i (t). 

Exercise 3.19 

Find the phasor / in terms of B and 9 in (3.43). 

The voltage dropped across the resistor is 

V R (t) = Ri(t) 

= i?Re{/e^*} (3.44) 

= Re{RIe jwt }. 
Thus the phasor representation for Vr (t) is 

Vr (t) <- V R ; V R = RI. (3.45) 

We call R the impedance of the resistor because R is the scale constant 
that relates the "phasor voltage Vr' to the "phasor current I." 
The voltage dropped across the inductor is 

V L (t) = Lj t {t) = LjRe{Ie^}. (3.46) 
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The derivative may be moved through the Re [ ] operator (see Exer- 
cise 3.20) to produce the result 

V L (t) = LReiJcuIe^} 
= ReiJojLIe^}. 

Thus the phasor representation of Vj, (t) 

V L (t) ~V L ;V L = jtoLI. (3.48) 

We call jivL the impedance of the inductor because ju>L is the complex 
scale constant that relates "phasor voltage VjJ to "phasor current I." 

Exercise 3.20 

Prove that the operators A and Re [] commute: 

jKe{e jU}t ) = Re{je jut }. (3.49) 

The voltage dropped across the capacitor is 

V c (t) = ^fi (t) dt = 1 j Re{Ie jut }dt. (3.50) 

The integral may be moved through the Re [ ] operator to produce the 
result 

V c (t) = lRe{±e juJt \ 

W c x ^ s 3.51 

= M^e>*}. 
Thus the phasor representation of Vc (t) is 

V c (t) ^ V c ; v c=j^c (3-52) 

We call -Jjg the impedance of the capacitor because -X^ is the complex 
scale constant that relates "phasor voltage Vc" to "phasor current I." 

Kirchhoff's Voltage Law. Kirchhoff's voltage law says that the 
voltage dropped in the series combination of R, L, and C illustrated in 
Figure 3.12 equals the voltage generated by the source (this is one of 
two fundamental conservation laws in circuit theory, the other being a 
conservation law for current): 

V (t) = V R (t) + V L (t) + V c (t) . (3.53) 
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If we replace all of these voltages by their complex representations, we 
have 



Re{Ve jut } = Re{{V R + V L + V c ) e jajt }. 
An obvious solution is 



(3.54) 



V = Vr + V l + Vc 

= (r + juL+J^I 



(3.55) 



where I is the phasor representation for the current that flows in the cir- 
cuit. This solution is illustrated in Figure 3.13, where the phasor voltages 
RI,ju)LI, and -^jl are forced to add up to the phasor voltage V. 




Figure 3.13: Phasor Addition to Satisfy Kirchhoff's Law 



Exercise 3.21 

Redraw Figure 3.13 for R = ujL 



1. 



Impedance. We call the complex number R + juiL + -^-^ the complex 
impedance for the series RLC network because it is the complex number 
that relates the phasor voltage V to the phasor current I: 



V = ZI 
Z= R + jujL 4 



(3.56) 



juC- 
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The complex number Z depends on the numerical values of resistance 
(R), inductance (L), and capacitance (C), but it also depends on the 
angular frequency (to) used for the sinusoidal source. This impedance 
may be manipulated as follows to put it into an illuminating form: 

Z = R + j(ujL--^) 

rri \— i \ ( 3 - 57 ) 

V ° V luVLC J 

The parameter ujq = -y= is a parameter that you will learn to call an 
"undamped natural frequency" in your more advanced circuits courses. 
With it, we may write the impedance as 

Z = R + jcu L { — - — ) . (3.58) 

V wo w / 

The frequency — is a normalized frequency that we denote by v. Then 
the impedence, as a function of normalized frequency, is 

Z(y) = R + JLo a L (v- -j . (3.59) 

When the normalized frequency equals one (y = 1), then the impedance 
is entirely real and Z = R. The circuit looks like it is a single resistor. 



\Z{v)\ = R[l + {"-£f{v-lf] 
argZ(v) = tan- 1 ^{v-\). 



1/2 



(3.60) 



R 

The impedance obeys the following symmetries around v = 1: 



Z(v) = Z*(l) 

\Z{u)\ = \Z(l)\ (3.61) 

arg Z (v) = - arg Z (±) . 

In the next paragraph we show how this impedance function influences 
the current that flows in the circuit. 

Resonance. The phasor representation for the current that flows the 
current that flows in the series RLC circuit is 

I = -I?— 

z{v) (3.62) 

- 1 -iarqZMy V ' 

~ \Z{u)\ e V 
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The function H (v) = -^-r displays a "resonance phenomenon." that is, 
\H (v) | peaks at v = 1 and decreases to zero and v = and v = oo: 



\H(u)\ = { 



0, 

j_ 

R 
0, 



(3.63) 



When \H (v) \ = 0, no current flows. 

The function \H (v) \ is plotted against the normalized frequency 
v =— in Figure 3.14. The resonance peak occurs at v = 1, where 

|-ff (^) | =jj meaning that the circuit looks purely resistive. Resonance 
phenomena underlie the frequency selectivity of all electrical and mechan- 
ical networks. 



versus v 




Figure 3.14: Resonance in a Series RLC Circuit 



Exercise 3.22 

(MATLAB) Write a MATLAB program to compute and plot 
\H (y) | and argH (y) versus v for v ranging from 0.1 to 10 in 
steps of 0.1. Carry out your computations for cjo^ = 10, 1,0.1, 
and 0.01, and overplot your results. 

Circle Criterion and Power Factor. Our study of the impedance 
Z (y) and the function H (v) = -^jp- brings insight into the resonance of 
an RLC circuit and illustrates the ffequency selectivity of the circuit. But 
there is more that we can do to illuminate the behavior of the circuit. 



\ = M- ! luL- -^- ] /. 



(3.64) 
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This equation shows how voltage is divided between resistor voltage RI 
and inductor-capacitor voltage j (uiL — ^) /. 

V = RI + juj L (— - — ) I (3.65) 

\u>o u> J 



V = RI+ t^L 1 \ RI . (3.66) 

In order to simplify our notation, we can write this equation as 

V = V R + jk (i/) V R (3.67) 

where Vr is the phasor voltage RI and k (u) is the real variable 

(3.67) brings very important geometrical insights. First, even though 
the phasor voltage Vr in the RLC circuit is complex, the terms Vr and 
jk (y) Vr are out of phase by | radians. This means that, for every allow- 
able value of Vr, the corresponding jk (y) Vr must add in a right triangle 
to produce the source voltage V. This is illustrated in Figure 3.15(a). 
As the frequency v changes, then k {y) changes, producing other values 
of Vr and jk (y) Vr that sum to V. Several such solutions for Vr and 
jk (y) Vr are illustrated in Figure 3.15(b). From the figure we gain the 
clear impression that the phasor voltage V>n lies on a circle of radius y 
centered at y Let's try this solution, 

V R = ?- + ^e^ 
R 2 2 (3.69) 

(1 + e^), 



v 

2 



and explore its consequences. When this solution is substituted into 
(3.67), the result is 

V = Y- (i + e ^) + jk (i/) ^ (1 + e?+) (3.70) 



or 



(l + e>1>)[l+jk(u)]. (3.71) 
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V. ^ji(v)V„ 



(a) 




Figure 3.15: The Components of V; (a) Addition of Vr and 
jk (v) Vr to Produce V, and (b) Several Values of Vr and jk (u) Vr 
that Produce V 



If we multiply the left-hand side by its complex conjugate and the 
right-hand side by its complex conjugate, we obtain the identity 



2(1 + cos^P) [l + k 2 (i/)] . 



(3.72) 



This equation tells us how the angle ip depends on k (v) and, conversely, 
how k (v) depends on ip: 



cos tp 



fc 2 H 



1 - k 2 (i/) 
1 + k 2 Jy) 

cosip 



1 



1 + COSlj) 



(3.73) 



(3.74) 



The number costp lies between —1 and +1, so a circular solution does 
indeed work. 

Exercise 3.23 

Check —1 < costp < 1 for — oo < k < oo and — oo < k < oo for 
—TT<ifj<Tr. Sketch k versus tp and ip versus k. 

The equation Vr = \ (l + e^) is illustrated in Figure 3.16. The angle 
that Vr makes with V is determined from the equation 



2<j) + lT-1p 



</>: 



i> 



(3.75) 
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Figure 3.16: The Voltages V and Vr, and the Power Factor cosq 



In the study of power systems, coscj) is a "power factor" that determines 
how much power is delivered to the resistor. We may denote the power 
factor as 



T] = coscj) = cos 



i> 



But cosip may be written as 



v> 



r\ = coscp = cos- 

z 

But cosip may be written as 

costp = cos (<f> + cf>) = cos 2 <f> sin 2 <f> 

= COS 2 (j) — (l — cos 2 <p) 
= 2cos 2 (j) - 1 

= 2r) 2 - 1. 

Therefore the square of the power factor r\ is 

2 COSIp +1 1 



Tf 



l + k 2 {v) 



(3.76) 



(3.77) 



(3.78) 



(3.79) 
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The power factor is a maximum of 1 for k (y) = 0, corresponding to 
v = l(cj = luq). It is a minimum of for k{y) = ±oo, corresponding to 

v = 0, oo(w = 0, oo). 

Exercise 3.24 

With fc defined as k{u) = ^{v - \), plot A: 2 (i/), cos^, and 
?7 2 versus ja 

Exercise 3.25 

Find the value of v that makes the power factor r\ = 0.707. 



3.7 Phasors: Light Scattering by a Slit 9 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

One of the most spectacular successes for phasor analysis arises in the 
study of light diffraction by a narrow slit. The experiment is to shine 
laser light through a slit in an otherwise opaque sheet and observe the 
pattern of light that falls on a distant screen. When the slit is very narrow 
compared with the wavelength of the light, then the light that falls on 
the screen is nearly uniform in intensity. However, when the width of the 
slit is comparable to the wavelength of the light, the pattern of light that 
falls on the screen is scalloped in intensity, showing alternating light and 
dark bands. The experiment, and the observed results, are illustrated in 
Figure 3.17. 



9 This content is available online at <http://cnx.Org/content/m21470/l.7/>. 
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Figure 3.17: Light Diffraction by a Slit 



Why should this experiment produce this result? Phasor analysis illu- 
minates the question and produces an elegant mathematical description 
of a profoundly important optical experiment. 

Huygens's Principle. We will assume, as Christiaan Huygens did, 
that the light incident on the slit sets up a light field in the slit that may 
be modeled by N discrete sources, each of which radiates a "spherical 
wave of light." This model is illustrated in Figure 3.18. The distance 
between sources is d, and Nd = L is the width of the slit. Each source is 
indexed by n, and n runs from to N — 1. The th source is located at 
the origin of our coordinate system. 

The spherical wave radiated by the n th source is described by the 
equation 



E{r ni t) = Re{ 



e j[wt-(2ir/A)r„] 



N 



}• 



(3.80) 
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The function E (r„, t) describes the "electric field" at time t and distance 
r n from the n th source. The field is constant as long as the variable 
iot— (2n/\) r n is constant. Therefore, if we freeze time at t = to, the field 
will be constant on a sphere of radius r n . This is illustrated in Figure 3.18. 



E(r n ,t o ) 




is constant 



JV-1 o 



Figure 3.18: Huygens's Model for Light Diffraction 



Exercise 3.26 

Fix r„ in E (r n , t) and show that E (r„, t) varies cosinusoidally 
with time t. Sketch the function and interpret it. What is its 
period? 

Exercise 3.27 

Fix t in E(r n ,t) and show that E(r n ,t) varies cosinusoidally 
with radius r n . Sketch the function and interpret it. Call the 
"period in r n " the "wavelength." Show that the wavelength is A. 

Exercise 3.28 

The "crest of the wave E (r n ,t)" occurs when ojt—(2ir/X) r n = 0. 
Show that the crest moves through space at velocity v = uj\/2it. 

Geometry. If we now pick a point P on a distant screen, that point 
will be at distance r$ from source 0, ...,r„ from source n, ..., and so on. 
If we isolate the sources and n, then we have the geometric picture of 
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Figure 3.19. The angle <fi is the angle that point P makes with the hori- 
zontal axis. The Pythagorean theorem says that the connection between 
distances r and r n is 



[r n — nd sin <f>) + (nd cos <f>) = r . 



(3.81) 




Figure 3.19: Geometry of the Experiment 



Let's try the solution 



r n = tq + ndsincj). 
This solution produces the approximate identity 

r + [nd cos 4>) = r 



(3.82) 
(3.83) 



Tq + (nd cos 4>) = rg 



(3.84) 
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This will be close for — < < 1. We will assume that the slit width 
L is small compared to the distance to any point on the screen. Then 
— = — < < 1, in which case the approximate solution for r n is valid for 
all n. This means that, for any point P on the distant screen, the light 
contributed by the n th source is approximately 



E n {(j>,t) = R e {^ e J'M-(2ir/A)(ro+nd«n^)]j. 



j^ e | A_ e -j(2w/\)ro e -JC2w/\)ndsin<l> e Ju>t\_ 



(3.85) 



■ N 

The phasor representation for this function is just 

En (</,) = _ c -j(2*/A)n, e -j(2>r/A)n<Wrtf ( 3 _g 6 ) 

Note that E (<f>), the phasor associated with the th source, is 
A e -j(2-K/\)r _ Therefore we may write the phasor representation for the 
light contributed by the n source to be 

E n (0) = E {4>) e-^l^^. (3.87) 

This result is very important because it shows the light arriving at point 
P from different sources to be "out of phase" by an amount that depends 
on the ratio ^f^ 

Phasors and Interference. The phasor representation for the field 
observed at point P on the screen is the sum of the phasors contributed 
by each source: 

N-l N-l 

E{4>)=Y] E n (</>) = E (<f>) J2 e- j ^ /x)ndsin ' t '. (3.88) 

This is a sum of the form 

N-l 

E{4>) = E {4>)Y,e jn6 (3.89) 

n=0 

where the angle 9 is (2n/\) dsin<j>. This sum is illustrated in Figure 3.20 
for several representative values of 6. Note that for small 8, meaning small 
<f>, the sum has large magnitude, whereas for 9 on the order of 2ir/N, the 
sum is small. This simple geometric interpretation shows that for some 
values of <j>, corresponding to some points P on the screen, there will be 
constructive interference between the phasors, while for other values of </> 
there will be destructive interference. Constructive interference produces 
bright light, and destructive interference produces darkness. 
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d sin <j>, 



Figure 3.20: Phasor Sums for Diffraction 



The geometry of Figure 3.20 is illuminating. However, we already 
know from our study of complex numbers and geometric sums that the 
phasor sum of Equation 3.85 may be written as 



E{4>)=E {<j>) 



1 



-j(2ir/\)Ndsinct> 



1 p— j (27Z / X)dsin4> 

This result may be manipulated to produce the form 



E{4>) 



_ e -j(2Tr/\)r 0e -j(TT/\)(N-l)dsin4> 



sin (NTTj-sincf)) 



(3.90) 



(3.91) 



N sin (irj-sincp) 

The magnitude is the intensity of the light at angle </> from horizontal: 

A sin (Nirj-sincfi) 



\E(cf>)\ 

Exercise 3.29 

Derive (3.91) from (3.90). 



N sin (irjsir 



(3.92) 



105 



Limiting Form. Huygens's model is exact when d shrinks to and N 
increases to infinity in such a way that Nd — > L, the slit width. Then 



\E(<f>) 






(3.93) 



This function is plotted in Figure 3.21 for two values of k- the width 
of the slit measured in wavelengths. When k- < < 1 (i.e., j- > > 1), 
then the light is uniformly distributed on the screen. However, when 
y > 1 (^ < l), then the function has many zeros for | sin <f>\ < 1, as 
illustrated in the figure. These zeros correspond to dark spots on the 
screen where the fields radiated from the infinity of points within the slit 
interfere destructively. 




Figure 3.21: Interference Pattern for a Slit 



Exercise 3.30 

Derive (3.93) from (3.92). 
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Exercise 3.31 

(MATLAB) Plot the discrete approximation 



,\ 



sin (Nir-^sintpJ 



sin (irj-sin<f>) 



(3.94) 



forf 



,\<f 

A 



versus sin 
with the continuous, limiting form 



10 and N = 2,4, 8, 16, 32. Compare 



Asin (itk-sin(j>) 



Ti-^sin<i 



(3.95) 



3.8 Phasors: Numerical Experiment (Interfer- 
ence Patterns) 10 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Let's add two sinusoids whose amplitudes and frequencies are identical 
and whose phases are different: 



x (t) = Acos (cut + </>) + Acos (cot + cf> + tp) . 
Show analytically that this sum has the phasor representation 



X 



2.1 ros |Y)e^ +! "^ 



(3.96) 



(3.97) 



Interpret this finding. Then write a MATLAB program that computes 
and plots complex X on the complex plane as tp varies from to 2ir and 
that plots magnitude, \X\, and phase, argX, versus the phase angle tp. 
(You will have to choose tp = n^-,n = 0,1,... ,N — 1, for a suitable N.) 
When do you get constructive interfelence and when do you get destruc- 
tive interference? Now compute and plot x (t) versus t (you will need to 
discretize t) for several interesting values of tp. Explain your interference 
results in terms of the amplitude and phase of x (t) and the magnitude 



°This content is available online at <http://cnx.Org/content/m21473/l.6/>. 
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and phase of X. Use the subplots discussed in "An Introduction to MAT- 
LAB" (Section 8.1) to plot all of your results together. 
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Chapter 4 

Linear Algebra 



4.1 Linear Algebra: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

We use this chapter to introduce students to the algebraic structure of vec- 
tors and matrices and to introduce them to matrix computations. These 
matrix computations are used in the chapters "Vector Graphics" (Sec- 
tion 5.1), "Filtering" (Section 6.1), and "Binary Codes" (Section 7.1) to 
solve problems in vector graphics, filtering, and binary coding. 

Vectors are introduced in the section "Vectors" (Section 4.2), along 
with algebraic and geometric interpretations of some fundamental vector 
operations and properties. The section "Inner Product and Euclidean 
Norm" (Section 4.3), the section "Direction Cosines" (Section 4.4), and 
the section "Projections" (Section 4.5) introduce inner products and their 
applications, including norm, direction cosines, orthogonality, and projec- 
tions. Some important alternatives to the Euclidean norm are introduced 
in the section "Other Norms" (Section 4.6). Matrices are motivated and 
introduced in this section (Section 4.7). The notation in these sections can 
be daunting to the beginner, so we proceed very carefully, using example 
after example. In the section "Solving Linear Systems of Equations" (Sec- 
tion 4.8) we codify the elimination procedures that students have used in 



1 This content is available online at <http://cnx.Org/content/m21454/l.7/>. 
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high school to solve linear systems of equations. The MATLAB demon- 
stration in Demo 2 (p. 154) shows how to use MATLAB to solve linear 
equations. The section "Circuit Analysis" (Section 4.9) shows how linear 
algebra and MATLAB can be used to analyze dc circuits. The numeri- 
cal experiment "Circuit Design" (Section 4.10) gives students practice in 
building function files in MATLAB and shows how to solve a sequence of 
linear equations in order to design a circuit with desired properties. 

Occasionally we have placed important results in the problems. We 
feel that students should not miss the material in Exercise 3 in "Vec- 
tors" (Exercise 4.3), Exercise 3 in "Inner Product and Euclidean Norm" 
(Exercise 4.6), Exercise 3 in "Projections" (Problem 4.20), Exercise 1 in 
"Matrices" (Exercise 4.22), and Exercise 4 in "Matrices" (Exercise 4.25). 

4.1.1 Introduction 

Linear algebra is a branch of mathematics that is used by engineers and 
applied scientists to design and analyze complex systems. Civil engineers 
use linear algebra to design and analyze load-bearing structures such as 
bridges. Mechanical engineers use linear algebra to design and analyze 
suspension systems, and electrical engineers use it to design and analyze 
electrical circuits. Electrical, biomedical, and aerospace engineers use 
linear algebra to enhance X rays, tomographs, and images from space. In 
this chapter and the next we study two common problems from electrical 
engineering and use linear algebra to solve them. The two problems are (i) 
electrical circuit analysis and (ii) coordinate transformations for computer 
graphics. The first of these applications requires us to understand the 
solution of linear systems of equations, and the second requires us to 
understand the representation of mathematical operators with matrices. 
Much of linear algebra is concerned with systematic techniques for 
organizing and solving simultaneous linear equations by elimination and 
substitution. The following example illustrates the basic ideas that we 
intend to develop. 

Example 4.1 

A woman steps onto a moving sidewalk at a large airport and 
stands while the moving sidewalk moves her forward at 1.2 me- 
ters/seconds. At the same time, a man begins walking against 
the motion of the sidewalk from the opposite end at 1.5 me- 
ters/second (relative to the sidewalk). If the moving sidewalk is 
85 meters long, how far does each person travel (relative to the 
ground) before they pass each other? 

To solve this problem, we first assign a variable to each un- 
known quantity. Let x\ be the distance traveled by the woman, 



Ill 



and let x 2 be the distance traveled by the man. The sum of the 
two distances is 85 meters, giving us one equation: 

xi + x 2 = 85. (4.1) 

Our second equation is based on the time required before they 
pass. Time equals distance divided by rate, and the time is the 
same for both people: 



1.2 



X 2 



1.5- 1.2 



0.3a;i - 1.2x 2 = 0. 



(4.2) 



We may substitute (4.2) into (4.1) to obtain the result 

X2 = 85, or 



1.2 
0.3 



%2 



5x 2 = 85 => x 2 = 17. (4.3) 

Combining the result from (4.3) with that of (4.1), we find that 

xi = 68. (4.4) 

So the man travels 17 meters, and the woman travels 68 meters. 
(4.1) and (4.2) are the key equations of (4.1). They may be 
organized into the "matrix equation" 



1 
0.3 



1 
-1.2 



Xl 

x 2 



85 




The rules for matrix- vector multiplication are evidently 

(1) xi + (l)x 2 = 85 



(4.5) 



(4.6) 



(0.3) an + (-1.2) ar 2 = 0. 

(4.2) and (4.3) may be organized into the matrix equation 




0.3 



5 
-1.2 



Xl 

x 2 



85 




(4.7) 



(4i 



This equation represents one partially solved form of (4.5), 
wherein we have used the so-called Gauss elimination procedure 
to introduce a zero into the matrix equation in order to isolate 
one variable. The MATLAB software contains built-in proce- 
dures to implement Gauss elimination on much larger matrices. 
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Thus MATLAB may be used to solve large systems of linear 
equations. 

Before we can apply linear algebra to more interesting phys- 
ical problems, we need to introduce the mathematical tools we 
will use. 



4.2 Linear Algebra: Vectors 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

For our purposes, a vector is a collection of real numbers in a one- di- 
mensional array. 3 We usually think of the array as being arranged in a 
column and write 

Xi 
X2 
%3 



Notice that we indicate a vector with boldface and the constituent 
elements with subscripts. A real number by itself is called a scalar, in 
distinction from a vector or a matrix. We say that x is an n-vector, 
meaning that x has n elements. To indicate that x\ is a real number, we 
write 



X\ € 1Z, 



(4.9) 



meaning that x\ is contained in 1Z, the set of real numbers. To indicate 
that a; is a vector of n real numbers, we write 



x£K n , 



(4.10) 



2 This content is available online at <http://cnx.Org/content/m21467/l.6/>. 

3 In a formal development of linear algebra, the abstract concept of a vector space 
plays a fundamental role. We will leave such concepts to a complete course in linear 
algebra and introduce only the functional techniques necessary to solve the problems 
at hand. 
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meaning that x is contained in R n , the set of real n-tuples. Geometrically, 
_R"is n-dimensional space, and the notation x € lZ n means that x is a point 
in that space, specified by the n coordinates X\,X2, ...,a;„. Figure 4.1 
shows a vector in R 3 , drawn as an arrow from the origin to the point x. 
Our geometric intuition begins to fail above three dimensions, but the 
linear algebra is completely general. 




Figure 4.1: A Vector in R 3 



We sometimes find it useful to sketch vectors with more than three 
dimensions in the same way as the three-dimensional vector of Figure 4.1. 
We then consider each axis to represent more than one dimension, a hy- 
perplane, in our n-dimensional space. We cannot show all the details of 
what is happening in n-space on a three-dimensional figure, but we can 
often show important features and gain geometrical insight. 

Vector Addition. Vectors with the same number of elements can be 
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added and subtracted in a very natural way: 



xi + 2/1 

^2+2/2 

•'•-.'/= £3 + 2/3 :•'■-// 
I 

Xn T" 2/n 

Example 4.2 

The difference between the vector x 



xi- 2/1 

X2 -2/2 

£3 -2/3 



y 



is the vector z 



y 



1 



(4.11) 



and the vector 



These vectors are 



1 J [_ ° 

illustrated in Figure 4.2. You can see that this result is consistent 
with the definition of vector subtraction in (4.11). You can also 
picture the subtraction in Figure 4.2 by mentally reversing the 
direction of vector y to get — y and then adding it to x by sliding 
it to the position where its tail coincides with the head of vector 
x. (The head is the end with the arrow.) When you slide a 
vector to a new position for adding to another vector, you must 
not change its length or direction. 
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Figure 4.2: Subtraction of Vectors 



Exercise 4.1 

Compute and plot x + y and x — y for each of the following 
cases: 



a. x 



1 




l 


3 


, y = 


2 


2 




3 



-1 




l 


3 


, y = 


2 


-2 




3 



C. X 



1 




1 


-3 


, 2/ = 


3 


2 




2 



Scalar Product. Several different kinds of vector multiplication are 
defined. 4 We begin with the scalar product. Scalar multiplication is 



4 The division of two vectors is undefined, although three different ,Audivisions,Au 
are denned in MATLAB. 
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defined for scalar a and vector x as 



ax\ 
ax 2 
ax 3 

I 



(4.12) 



If \a\ < 1, then the vector ax is "shorter" than the vector x; if \a\ > 1, 
then the vector ax is , "longer" than x. This is illustrated for a 2- vector 
in Figure 4.3. 




X, 



Figure 4.3: The Scalar Product ax 



Exercise 4.2 



Compute and plot the scalar product ax when x 



each of the following scalars: 

a. a = l; 

b. a = — 1; 

c. a = -1/4; 

d. a = 2. 



1 
1/2 
1/4 



for 
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Exercise 4.3 

Given vectors x,y,z e lZ n and the scalar a & 1Z, prove the 
following identities: 

a. x + y = y + x. Is vector addition commutative? 

b. (x + y) + z = x + (y + z). Is vector addition associative? 

c. a (x + y) = ax + ay. Is scalar multiplication distributive 
over vector addition? 



4.3 Linear Algebra: Inner Product and Eu- 
clidean Norm 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The inner product (x,y) between vectors x and y is a scalar consisting of 
the following sum of products: 

(x, y) = Xiyi + x 2 y 2 + x 3 y 3 H h x n y n . (4.13) 

This definition seems so arbitrary that we wonder what uses it could 
possibly have. We will show that the inner product has three main uses: 

i. computing length or "norm", 

ii. finding angles between vectors and checking for "orthogonality", and 
iii. computing the "component of one vector along another" (projec- 
tion). 

Since the inner product is so useful, we need to know what algebraic 
operations are permitted when we are working with inner products. The 
following are some properties of the inner product. Given x,y,z £ lZ n 
and a € TZ, 

i- {x, y) = (y,x); 

ii. (ax, y) = a (x, y) = (x, ay); and 
iii. (x,y + z) = (x,y) + (x,z). 



5 This content is available online at <http://cnx.Org/content/m21452/l.6/>. 
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Exercise 4.4 

Prove the three preceding properties by using the definition of 
inner product. Is the equation x (y, z) = {x,y)z also a true 
property? Prove or give a counterexample. 

Euclidean Norm. Sometimes we want to measure the length of a vector, 
namely, the distance from the origin to the point specified by the vector's 
coordinates. A vector's length is called the norm of the vector. Recall 
from Euclidean geometry that the distance between two points is the 
square root of the sum of the squares of the distances in each dimension. 
Since we are measuring from the origin, this implies that the norm of the 
vector x is 



11*11 = 



(4.14) 



Notice the use of the double vertical bars to indicate the norm. An 
equivalent definition of the norm, and of the norm squared, can be given 
in terms of the inner product: 



II x ||= y/{x,x) 



(4.15) 



|| a; || = {x,x) 



(4.16) 



Example 4.3 

The Euclidean norm of the vector 



(4.17) 



is || x ||= Y / l 2 + 3 2 + 5 2 + (-2) 2 = V39. 

An important property of the norm and scalar product is that, for any 
x e TZ n and a e K, 



\ax\\ = \a\\\x\ 



(4.18) 



So we can take a scalar multiplier outside of the norm if we take its 
absolute value. 
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Exercise 4.5 

Prove (4.18). 

Cauchy-Schwarz Inequality. Inequalities can be useful engineering 
tools. They can often be used to find the best possible performance of 
a system, thereby telling you when to quit trying to make improvements 
(or proving to your boss that it can't be done any better). The most 
fundamental inequality in linear algebra is the Cauchy-Schwarz inequality. 
This inequality says that the inner product between two vectors x and y 
is less than or equal (in absolute value) to the norm of x times the norm 
of y, with equality if and only if y = ax: 

\{x,y)\<\\x\\\\y\\. (4.19) 

To prove this theorem, we construct a third vector z = \x — y and 
measure its norm squared: 

IIAac - y\\ 2 = (\x -y,Xx-y) = \ 2 \\x\\ 2 - 2A (x,y) + \\y\\ 2 > 0. (4.20) 

So we have a polynomial in A that is always greater than or equal to 
(because every norm squared is greater than or equal to 0). Let's assume 
that x and y are given and minimize this norm squared with respect to 
A. To do this, we take the derivative with respect to A and equate it to 0: 



2A||:r|| 2 -2{x,y) = 0^ A 



(x,y) 

IMI 2 



(4.21) 



When this solution is substituted into the formula for the norm squared 
in (4.20), we obtain 



(x,y) 

.IMI 2 

which simplifies to 



IMI 2 - ^ (*,,) + IMI 2 >o, 
IMI 



(4.22) 



^^ + IMI 2 >o^(x, 2/ ) 2 <|M| 2 |M| 2 . 



(4.23) 



The proof of the Cauchy-Schwarz inequality is completed by taking the 
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positive square root on both sides of (4.23). When y = ax, then 

(x, y) = (x, ax) 2 = [\a\(x,x)f = (\a\\\x\\ 2 ) 

(m 2 imi 2 )imi 2 

= (ax, ax) \\x\\ (4. 24) 

{y,y)\\x\\ 2 

II 1 12 1 1 1 12 

\\y\\ \\ x \\ » 

which shows that equality holds in (4.19) when y is a scalar multiple of 

x. 

Exercise 4.6 

Use the Cauchy-Schwarz inequality to prove the triangle in- 
equality, which states 

I|z + V||<IMI + IMI- (4-25) 

Explain why this is called the triangle inequality. 



4.4 Linear Algebra: Direction Cosines 6 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Unit Vectors. Corresponding to every vector x is a unit vector u x 
pointing in the same direction as x. The term unit vector means that the 
norm of the vector is 1: 

IK|| = 1. (4.26) 

The question is, given x, how can we find u x ? The first part of the answer 
is that u x will have to be a positive scalar multiple of x in order to point 
in the same direction as x, as shown in Figure 4.4. Thus 



ax. (4.27) 



6 This content is available online at <http://cnx.Org/content/m21449/l.8/>. 
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Figure 4.4: The Unit Vector u x 



But what is a? We need to choose a so that the norm of u x will be 1: 

||«x|| = l (4-28) 



\ax\ 



1 



(4.29) 



Ml 



i 



(4.30) 



1 

Ml 



(4.31) 



We have dropped the absolute value bars on a because ||x|| is positive. 
The a that does the job is 1 over the norm of x. Now we can write 
formulas for u x in terms of x and x in terms of u x : 



1 



(4.32) 



X = ||x||Ua;. 



(4.33) 



So the vector x is its direction vector u x , scaled by its Euclidean norm. 
Unit Coordinate Vectors. There is a special set of unit vectors 
called the unit coordinate vectors. The unit coordinate vectorei is a unit 
vector in V™ that points in the positive direction of the i th coordinate 
axis. Figure 4.5 shows the three unit coordinate vectors in V 3 . 
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X- 



i ii e 




x. 



Figure 4.5: Unit Coordinate Vectors in R 3 



For three-dimensional space, _R 3 , the unit coordinate vectors are 



ei 



1 















, e 2 = 


1 


, e 3 = 















1 



(4.34) 



More generally, in n-dimensional space, there are n unit coordinate vec- 
tors given by 



123 



e,; = 



01 



1 




i th element 



n elements. 



Figure 4.6 



You should satisfy yourself that this definition results in vectors with 
a norm of 1. 

Exercise 4.7 

Find the norm of the vector au where u is a unit vector. 

Exercise 4.8 

Find the unit vector u x in the direction of 



a. x 



c. x 



3 




4 
3 


; 


6 


-2 
1 


-1 


1 


-1 





Direction Cosines. We often say that vectors "have magnitude and 
direction." This is more or less obvious from "Linear Algebra: Vec- 
tors" (Figure 4.1), where the three-dimensional vector x has length 
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V4 



xi and points in a direction defined by the components 



£1,2:2, and X3. It is perfectly obvious from (4.33) where x is written 
as x = \\x\\u x . But perhaps there is another representation for a vector 
that places the notion of magnitude and direction in even clearer evidence. 
Figure 4.7 shows an arbitrary vector x € 1Z 3 and the three-dimensional 
unit coordinate vectorsei, ei^e-s- The inner product between the vector x 
and the unit vector e k just reads out the k th component of x: 



(x,e k ) = (e k ,x) = x k . 



(4.35) 



Since this is true even in R n , any vector x € lZ n has the following 
representation in terms of unit vectors: 



x = (x, ex) ei + (x, e 2 ) e 2 H h (x, e„) e„. 



(4.36) 




Figure 4.7: The Three-Dimensional Unit Vectors 



Let us now generalize our notion of an angle 9 between two vectors to 
R n as follows: 



cosO 



(x,y) 

MUM 



(4.37) 
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The celebrated Cauchy-Schwarz inequality establishes that — 1— < cos 
9 < 1. With this definition of angle, we may define the angle 9 k that a 
vector makes with the unit vector e k to be 



cosOk 



(x,e k ) 

Milled 



But the norm of e k is 1, so 



cosv k 



(x,e k ) 

INI 



Xk 

\\x\\ 



(4.38) 



(4.39) 



When this result is substituted into the representation of x in (4.36), we 
obtain the formula 



|x|| cos 9\e\ + \\x\\ cos 9-ie-i + ■ ■ ■ + \\x\\ cos 
\\x\\ {cos9\e\ + cos9iCi + • ■ ■ + cos9 n e n ) . 



(4.40) 



This formula really shows that the vector x has "magnitude" ||x|| and 
direction (9\, #2, •••, 9 n ) and that the magnitude and direction are sufficient 
to determine x. We call ( cos9i, cos 9 2 ,---, cos 9 n ) the direction cosines 
for the vector x. In the three-dimensional case, they are illustrated in 
Figure 4.7. 

Exercise 4.9 

Show that (4.37) agrees with the usual definition of an angle in 
two dimensions. 

Exercise 4.10 

Find the cosine of the angle between x and y where 



a. x 



c. x 



, V 





-l 







, y = 


i 









4 


, y = 


2 




-4 
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If we compare (4.33) and (4.40) we see that the direction vector u x is 
composed of direction cosines: 



cos9iei + cosd 2 e2 



costt n e r 



cosOi 

COS02 



(4.41) 



With this definition we can write (4.40) compactly as 

Here x is written as the product of its magnitude ||a;|| and its direction 
vector u x . Now we can give an easy procedure to find a vector's direction 
angles: 

(i) And | |a;||; 

(ii) calculate u x = jf-n', and 

(iii) take the arc cosines of the elements of u x . 

Step (iii) is often unnecessary; we are usually more interested in the 
direction vector (unit vector) u x . Direction vectors are used in materials 
science in order to study the orientation of crystal lattices and in elec- 
tromagnetic field theory to characterize the direction of propagation for 
radar and microwaves. You will find them of inestimable value in your 
courses on electromagnetic fields and antenna design. 

Exercise 4.11 

Sketch an arbitrary unit vector u G 1Z 3 . Label the direction 
cosines and the components of u. S 

Exercise 4.12 

Compute the norm and the direction cosines for the vector x = 

4 
2 
6 

Exercise 4.13 

Prove that the direction cosines for any vector satisfy the equal- 
ity 



cos 62 



1. 



(4.42) 



What does this imply about the number of scalars needed to 
determine a vector x € lZ n ? 
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Exercise 4.14 

Astronomers use right ascension, declination, and distance to 
locate stars. On Figure 4.7 these are, respectively, —<fi, | — 9 3 , 
and ||x||. Represent x = {x\,X2,Xs) in terms of 0,#3, and ||x|| 
only. (That is, find equations that give <f>, #3, and ||x|| in terms 
of :ri,iE2, and X3, and find equations that give xi,X2, and X3 in 
terms of </>, 63, and ||x||. 

Exercise 4.15 

(MATLAB) Write a MATLAB function that accepts any vector 
x g lZ n and computes its norm and direction cosines. Make x 
an input variable, and make ||x|| and u x output variables. 

Exercise 4.16 

Let x and y denote two vectors in R n with respective direction 
cosines ( cos8i,cos82, ...,cosd n ) and ( cosifii, cosfa, ■■■, cosif) n ). 
Prove that ip, the angle between x and y, is 

COS tp = COs9\ COS (f>i + COS02 COS (j>2 + • • • + cos6 n cos (f) n . (4.43) 

Specialize this result to R 2 for insight. 
Exercise 4.17 

Compute the angle between the vectors x : 
Sketch the result. 



2 




2 


3 


and 


3 







1 



4.5 Linear Algebra: Projections 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Orthogonality. When the angle between two vectors is ir/2 (90°), we 
say that the vectors are orthogonal. A quick look at the definition of angle 



7 This content is available online at <http://cnx.Org/content/m21465/l.6/>. 
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(Equation 12 from "Linear Algebra: Direction Cosines" (4.37)) leads to 
this equivalent definition for orthogonality: 



(x, y) = <f> x and y are orthogonal. 
For example, in Figure 1(a) (Figure 4.8(a)), the vectors x 



(4.44) 
and 



y 



(i 



are clearly orthogonal, and their inner product is zero: 



Or, y) = 3 (-2) + 1 (6) = 
In Figure 1(b) (Figure 4.8(a)), the vectors x 



3 




-2 


1 


,y = 


6 











(4.45) 



and 



are mutually orthogonal, and the inner product between each 



pair is zero: 



(a:,y)=3(-2) + l(6)+0(0)=0 



(ar,«) = 3(0) + l(0) + 0(4) = 



(4.46) 



(4.47) 



(y,z) = -2 (0) + 6 (0) + (4) = 0. 



(4.48) 
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x 3 




(a) 
Figure 4.8: Orthogonality of Vectors 



■m 



(b) 



y= 



Exercise 4.18 

Which of the following pairs of vectors is orthogonal: 



a. x 



b. x 



1 










, y = 


l 


1 




_ o _ 



i 




l 


i 


, y = 


l 







l 



c. x = ei,y = e 3 ; 



a 


, y = 


-b 


b 




a 



We can use the inner product to find the projection of one vector onto 
another as illustrated in Figure 2 (Figure 4.9). Geometrically we find the 
projection of x onto y by dropping a perpendicular from the head of x 
onto the line containing y. The perpendicular is the dashed line in the 
figure. The point where the perpendicular intersects y (or an extension 
of y) is the projection of x onto y, or the component of x along y. Let's 
call it z. 
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Figure 4.9: Component of One Vector along Another 



Exercise 4.19 

Draw a figure like Figure 2 (Figure 4.9) showing the projection 
of y onto x. 

The vector z lies along y, so we may write it as the product of its norm 



|z|| and its direction vector u y : 



z = z u v 



(4.49) 



But what is norm ||z||? From Figure 2 (Figure 4.9) we see that the vector 
x is just z, plus a vector v that is orthogonal to y: 

x = z + v, (v,y)=0. (4.50) 

Therefore we may write the inner product between x and y as 

(x, y) = (z + v, y) = (z, y) + (v, y) = (z, y) . (4.51) 

But because z and y both lie along y, we may write the inner product 

(x, y) as 



(x,y) = (z,y) = (\\z\\uy,\\y\\u y ) = \\z\\\\y\\(u y ,Uy) 

IMIIMIIKII 2 = IMIIMI- 



(4.52) 



From this equation we may solve for \\z\ 
Equation 6 (4.49) to write z as 



T^nr- and substitute \\z II into 

\\y\\ " " 



(4.53) 



\V- 



_ ( x -,v) y _ (x,v) „ 
~ \\v\\ I Ml ~ {y,y) 1 

Equation 10 (4.53) is what we wanted-an expression for the projection 

of x onto y in terms of x and y. 
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Exercise 4.20 

Show that ||z|| and z may be written in terms of cos9 for 9 as 
illustrated in Figure 2 (Figure 4.9): 

||z|| = ||x|| cos 9 (4.54) 



\ x \\cost) 

ii y. (4.55) 



Orthogonal Decomposition. You already know how to decompose a 
vector in terms of the unit coordinate vectors, 

x = (x, ex) ex + (x, e 2 ) e 2 H h (x, e„) e„. (4.56) 

In this equation, (x, eh) ej~ is the component of x along e^, or the projec- 
tion of x onto efe, but the set of unit coordinate vectors is not the only 
possible basis for decomposing a vector. Let's consider an arbitrary pair 
of orthogonal vectors x and y: 

(x,y) = 0. (4.57) 

The sum of x and y produces a new vector w, illustrated in Figure 3 
(Figure 4.10), where we have used a two-dimensional drawing to represent 
n dimensions. The norm squared of w is 

IM| 2 = (w,w) = [(x + y) , (x + y)] = (x,x) + (x,y) + (y,x) + (y,y) 

I 1 2 2 

= IfII + llyll • 

This is the Pythagorean theorem in n dimensions! The length squared 
of w is just the sum of the squares of the lengths of its two orthogonal 
components. 
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w=x+y 




Figure 4.10: Sum of Orthogonal Vectors 



The projection of w onto x is x, and the projection of w onto y is y: 



w = (1) x + (1) y. 



(4.58) 



If we scale w by a to produce the vector z = aw, the orthogonal decom- 
position of z is 



z = aw = (a) x + (a) y. 



(4.59) 



Let's turn this argument around. Instead of building w from orthogonal 
vectors x and y, let's begin with arbitrary w and x and see whether we 
can compute an orthogonal decomposition. The projection of w onto x is 
found from Equation 10 (4.53): 



(w,x) 
(x,x)' 



(4.60) 



But there must be another component of w such that w is equal to the 
sum of the components. Let's call the unknown component w y . Then 



w = w x + w y . 



Now, since we know w and w x already, we find w v to be 

(w, x) 

W v = W — W x = W ; -X. 

(x,x) 



(4.61) 



(4.62) 
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Interestingly, the way we have decomposed w will always produce w x and 
w >y orthogonal to each other. Let's check this: 

(w,x) / \ fit), a;) 2 / \ 

( w ,x) 2 (w,x) 2 y ' 



(x,x) (x,x) 

0. 

To summarize, we have taken two arbitrary vectors, w and x, and de- 
composed w into a component in the direction of x and a component 
orthogonal to x. 

4.6 Linear Algebra: Other Norms 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Sometimes we find it useful to use a different definition of distance, cor- 
responding to an alternate norm for vectors. For example, consider the 
1-norm defined as 

\\x\\ 1 = {\x 1 \ + \x 2 \ + --- + \x n \), (4.64) 

where |x,| is the magnitude of component x;. There is also the sup-norm, 
the "supremum" or maximum of the components x\,...,x n : 

IMLp = max(\x 1 \,\x 2 \,...,\x n \). (4.65) 

The following examples illustrate what the Euclidean norm, the 1-norm, 
and the sup-norm look like for typical vectors. 

Example 4.4 

r -3 

I . Then 

2 



Consider the vector 



l. a; 



1/2 



(-3) 2 + (l) 2 + (2) 2 ] =(14) 1/2 ; 



3 This content is available online at <http://cnx.Org/content/m21463/l.7/>. 
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ii. ||a;|| 1 = (|-3| + |l| + |2|)=6;aiid 
iii- IML v = max (| - 3|,|1|,|2|)= 3. 



Example 4.5 

Figure 1 (Figure 4.11) shows the locus of two-component vectors 



Ml 



Xi 



X-2 



with the property that ||a;| 



1, x 



1, or 



sup 



locus of x such 
that l|xi| sup = 1 



X 2 locus of x such 



/ that ||x| 




locus of x such 



that ||x||, = 1 



Figure 4.11: Locus of Two-Dimensional Vectors Whose Various 
Norms Are 1 



life. 



The next example shows how the 1-norm is an important part of city 

Example 4.6 

The city of Metroville was laid out by mathematicians as shown 
in Figure 2 (Figure 4.12). A person at the intersection of Avenue 
and Street —2 (point A) is clearly two blocks from the center 
of town (point C). This is consistent with both the Euclidean 



v / 2 + (_2) 2 = VI =2 
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(4.66) 



and the 1-norm 



(4.67) 



But how far from the center of town is point B at the intersection 
of Avenue-2 and Street 1? According to the Euclidean norm, the 
distance is 



\B\ 



\/(-2f + (lf = V5. 



(4.68) 



t 

N 



C 



B 



Avenue 2 



Avenue 1 



Avenue 



Avenue -1 



Avenue -2 



Figure 4.12: Metroville, U.S.A. 



While it is true that point B is V5 blocks from C, it is also 
clear that the trip would be three blocks by any of the three 
shortest routes on roads. The appropriate norm is the 1-norm: 



U J 



111 



(4.69) 
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Even more generally, we can define a norm for each value of p from 1 to 
infinity. The so-called p-norm is 

\I x \\ p = (\ Xl \P + \ X2 \ P + ... + \ Xn \P)Vi>. (4.70) 

Exercise 4.21 

Show that the Euclidean norm is the same as the p-norm with 
p = 2 and that the 1-norm is the p-norm with p = 1. (It can 
also be shown that the sup-norm is like a p-norm with p = oo.) 

DEMO 4.1 (MATLAB). From the command level of MATLAB, type 
the following lines: 

> x = [l;3;-2;4] 

> y = [0;l;2;-0.5] 

> x - y 

Check to see whether the answer agrees with the definition of vector 
subtraction. Now type 

> a = -1.5 

» a * x 

Check the answer to see whether it agrees with the definition of scalar 
multiplication. Now type 

» x' * y 

This is how MATLAB does the inner product. Check the result. Type 

3> norm(y) 

> sqrt(y' * y) 

> norm(y,l) 
2> norm(y' * y) 

Now type your own MATLAB expression to find the cosine of the angle 
between vectors X and y. Put the result in variable t. Then find the angle 
9 by typing 

3> theta = acos(t) 

The angle 9 is in radians. You may convert it to degrees if you wish by 
multiplying it by 180/7T: 

> theta = theta * (180/pi) 
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4.7 Linear Algebra: Matrices 9 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The word matrix dates at least to the thirteenth century, when it was used 
to describe the rectangular copper tray, or matrix, that held individual 
leaden letters that were packed into the matrix to form a page of composed 
text. Each letter in the matrix, call it a^, occupied a unique position 
(ij) in the matrix. In modern day mathematical parlance, a matrix is a 
collection of numbers arranged in a two-dimensional array (a rectangle). 
We indicate a matrix with a boldfaced capital letter and the constituent 
elements with double subscripts for the row and column: 



A = 



On 
021 
031 



Oi2 

022 
«32 



013 
023 
033 



Oln 
d2n 
0-3n 



Oml O m 2 O m 3 

T 



second row 



third column 



Figure 4.13: Matrix 



In this equation A is an mxn matrix, meaning that A has m horizontal 
rows and n vertical columns. As an extension of the previously used 
notation, we write A s ■Ji mxn to show that A is a matrix of size mxn with 
dij € 1Z. The scalar element a,ij is located in the matrix at the i th row 
and the j th column. For example, 023 is located in the second row and 
the third column as illustrated in Figure 4.13. 

The main diagonal of any matrix consists of the elements an. (The 
two subscripts are equal.) The main diagonal runs southeast from the 



9 This content is available online at <http://cnx.Org/content/m21457/l.6/>. 
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top left corner of the matrix, but it does not end in the lower right corner 
unless the matrix is square (e lZ mxm ). 

The transpose of a matrix A s 7^™*" - 1S ano ther matrix B whose 



element in row j and column i is b 



j> 



for 1 < i < 



and 1 < 



j < n. We write B = A T to indicate that B is the transpose of A. In 
MATLAB, transpose is denoted by A' . A more intuitive way of describing 
the transpose operation is to say that it flips the matrix about its main 
diagonal so that rows become columns and columns become rows. 

Exercise 4.22 

If A e TZ mxn , then A T e ?. Find the transpose of the matrix 

2 1 " 

5 4 

7 9 

Matrix Addition and Scalar Multiplication. Two matrices of the 
same size (in both dimensions) may be added or subtracted in the same 
way as vectors, by adding or subtracting the corresponding elements. The 



equation C = A± B means that for each i and j, Ci 



an ± 



'■i'j- 



Scalar 



multiplication of a matrix multiplies each element of the matrix by the 
scalar: 



aX 



ax\\ ax\2 axi3 ... ax\ n 

ax 2 \ ax 2 2 ax 2 3 ... ax 2n 

ax 3 i ax 32 ax 33 ... ax 3n 

123 123 123 123 

Q'&ml ^m2 Q^m3 ••• Q^Cmn 



(4.71) 



Matrix Multiplication. A vector can be considered a matrix with only 
one column. Thus we intentionally blur the distinction between lZ nxl and 
_R n . Also a matrix can be viewed as a collection of vectors, each column 
of the matrix being a vector: 



A 



at a 2 







an 




ai2 




din 




= 




«21 

1 
a ml 




a-22 

1 

a m2 




0-2n 

1 
Qmn 





(4.72) 



In the transpose operation, columns become rows and vice versa. The 
transpose of an n x 1 matrix, a column vector, is a 1 xn matrix, a row 



vector: 



Xi 
X2 
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; x 



[x 1 x 2 x n \ 



(4.73) 



Now we can define matrix-matrix multiplication in terms of inner prod- 
ucts of vectors. Let's begin with matrices A e TZ mxn and B e !Z nxp . 
To find the product AB, first divide each matrix into column vectors and 
row vectors as follows: 



ai 



r 1 1 r 1 1 [ii 

bi b 2 ... bj, — 

Li J L I J 1 1 J. 



Figure 4.14 




Thus a, is the i column of A and cd is the j row of A. For matrix 
multiplication to be defined, the width of the first matrix must match 
the length of the second one so that all rows aj and columns bi have the 
same number of elements n. The matrix product, C = AB, is an m x p 
matrix defined by its elements as c^ = (cti,bj). In words, each element 
of the product matrix, c^ , is the inner product of the i th row of the first 
matrix and the j th column of the second matrix. 
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For n-vectors x and y, the matrix product x T y takes on a special 
significance. The product is, of course, a 1 x 1 matrix (a scalar). The 
special significance is that x T y is the inner product of x and y: 



= (x,y). 



Figure 4.15 



Thus the notation x T y is often used in place of (x,y). Recall from 
Demo 1 from "Linear Algebra: Other Norms" (p. 136) that MATLAB 
uses x'*y to denote inner product. 

Another special case of matrix multiplication is the outer product. 
Like the inner product, it involves two vectors, but this time the result is 
a matrix: 



A = 



1 


Ziyi 


X\V2 ' 


■ x ± y 


] 


Xi Vi 


XlVl ■ 


■ x-iV, 




_x m yi 


X m 1j2 ■ 


%m,y 


Figure 


4.16 







In the outer product, the inner products that define its elements are 
between one-dimensional row vectors of x and one-dimensional column 
vectors of y T , meaning the (i,j) element of A is xtyj. 
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Exercise 4.23 

Find C = AB where A and B are given by 



a. A 



b. A 



c. A 



B 



1 -1 2 

3 5 

1 

1 

1 -1 -1 
1 -1 1 
1 1 1 



0-2 1-3 
■ B =4220 
2-231 
12 3 4 
5 6 7 8 

3 6 

, B= 14 7 

2 5 8 



There are several other equivalent ways to define matrix multiplication, 
and a careful study of the following discussion should improve your un- 
derstanding of matrix multiplication. Consider A e lZ mxn ,B s lZ nxp , 
and C = AB so that C € lZ mxp . In pictures, we have 



m\C\ =m\A 



P 
B 



In our definition, we represent C on an entry-by-entry basis as 



Cij = {aubj) = S aikbkj- 



(4.74) 



(4.75) 



In pictures, 













a, T -] 






1 

1 















Figure 4.17 
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You will prove in Exercise 3 (Exercise 4.24) that we can also represent 
C on a column basis: 



£ dkbkj- 



fe=i 



(4.76) 



r 


Cj 


- 


.. 


' 1 " 
ai 




■ i " 

a 2 




' 1 " 






i 




■ 


[ 1 . 






L i . 








L 






! 





Figure 4.18 



Finally, C can be represented as a sum of matrices, each matrix being 
an outer product: 



C= Sai/3/ 

2—1 



(4.77) 



[- K -) 



Figure 4.19 



A numerical example should help clarify these three methods. 
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Example 4.7 

Let 



12 13 

2 12 4 

3 3 2 1 



, B 



1 2 1 

2 2 1 

1 3 2 

2 1 1 



(4.78) 



Using the first method of matrix multiplication, on an entry- 
by-entry basis, we have 



£ cukb 



k=i 



ik®kj 



(4.79) 



c 



(1-1 + 2-2 + 1 -1 + 3-2) 
(2- 1 + 1 -2 + 2- 1 + 4-2) 
(3- 1 + 3-2 + 2- 1 + 1 -2) 



(1-2 + 2 -2 + 1-3 + 3-1) (1-: 
(2-2 + 1-2 + 2-3 +(4.8Q)) (2 • 
(3 -2 + 3 -2 + 2 -3 + 1-1) (3-: 



C 



On a column basis, 



12 12 8 
14 16 11 

13 19 11 



k — 1 



(4.81) 



(4.82) 



ci 



1 




2 




1 




3 




1 


2 


1 + 


1 


2 + 


2 


1 + 


4 


2;c 2 = 


2 


3 




3 




2 




1 




3 



2 




1 




3 




l 




2 




1 


1 


2+ 


2 


3+ 


4 


i;c 3 = 


2 


1+ 


1 


1 + 


2 


3 




2 




1 




3 




3 




2 



2+ 
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3 

4 

1 
Collecting terms together, we have 



C = [cic 2 c 3 ] C 



(1 • 1 + 2-2 + 1- 1 + 3-2) (1-2 + 2-2 + 1-3 
(2 • 1 + 1 • 2 + 2 • 1 + 4 • 2) (2 • 2 + 1(4.83)- 2 • 3 
(3 • 1 + 3 • 2 + 2 • 1 + 1 • 2) (3-2 + 3-2 + 2-3 



On a matrix-by-matrix basis, 



c= xaiPi 

i—1 



(4.84) 



C = [123] [121] + [213] [221] + [132] + [122] [132] 
[341] [HI] 



(4.85) 



11 1-2 11 

2-1 2-2 2-1 
3-1 3-2 3-1 
11 1-3 1-2 

2-1 2-3 2-2 

2-1 2-3 2-2 



2-2 2-2 2-1 
1-2 1-2 11 
3-2 3-2 3-1 
3-2 3-1 3-1 
4-2 4-1 4-1 
1-2 11 11 



(4.86) 



C 



(1- 1 + 2-2 + 1 • 1 + 3-2) (1-2 
(2- 1 + 1 -2 + 2- 1 + 4-2) (2-2 
(3 • 1 + 3 • 2 + 2 • 1 + 1 • 2) (3-2 



2-2 + 1 -3 + 3-1) (1- 
1-2 + 2-3 +(4.81)) (2 
3-2 + 2-3 + 1-1) (3- 



145 



as we had in each of the other cases. Thus we see that the 
methods are equivalent-simply different ways of organizing the 
same computation! 

Exercise 4.24 

Prove that Equations 9 (4.75), 11 (4.76), and 13 (4.77) are 
equivalent definitions of matrix multiplication. That is, if C = 
AB where A £ K mxn and B e lZ nxp , show that the matrix- 
matrix product can also be defined by 



c 



fe=i 



^dikhj, (4.88) 



and, if Cfc is the k th column of C and a^ is the k th column of A, 
then 



J^akbkj- (4.89) 



fe=i 



Show that the matrix C may also be written as the , "sum of 
outer products" 



C = 5> fc #. (4.90) 



fc=i 
Write out the elements in a typical outer product a^/3j. 

Exercise 4.25 

Given A e K mxn ,B e K pxq , and C e K rxs , for each of the 
following postulates, either prove that it is true or give a coun- 
terexample showing that it is false: 

a. (A T ) T = A. 

b. AB = BA when n = p and m = q. Is matrix multiplication 
commutative? 

c. A (B + C) = AB + AC when n = p = r and q = s. Is 
matrix multiplication distributive over addition? 

d. ( AB T = B T A T when n = p. 

e. (AB) C = A (BC) when n = p and q = r. Is matrix 
multiplication associative? 
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Example 4.8: Rotation 

We know from the chapter on complex numbers (Section 1.1) 
that a complex number Z\ = X\ + jy\ may be rotated by angle 
9 in the complex plane by forming the product 

Z2 = e j0 Zl . (4.91) 

When written out, the real and imaginary parts of zi are 



z-i = (cos9 + jsinff) (x\ + jyi) 

= (cos8) xi — (sin9) y\ + j \{sin6) x\ + (cosO) y{\ 



(4.92) 



If the real and imaginary parts of z\ and z-i are organized into 
vectors z\ and z^ as in the chapter on complex numbers (Sec- 
tion 1.1), then rotation may be carried out with the matrix- 
vector multiply 



zi 



X-2 
2/2 



We call the matrix R (9) 



cos9 —sin9 
sin9 cos9 

cos9 —sin9 
sin9 cos9 



Xi 



(4.93) 



a rotation matrix. 



Exercise 4.26 

Let R(9) denote a 2 x 2 rotation matrix. Prove and interpret 
the following two properties: 



a. R T {9)=R{-9); 

b. R T {9)R{9) = R{9)R T {9) 



1 
1 



4.8 Linear Algebra: Solving Linear Systems of 
Equations 10 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 



°This content is available online at <http://cnx.Org/content/m21466/l.6/>. 
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for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

We are now equipped to set up systems of linear equations as matrix- 
vector equations so that they can be solved in a standard way on a com- 
puter. Suppose we want to solve the equations from Example 1 from 
"Linear Algebra: Introduction" (Example 4.1) for x\ and xi using a com- 
puter. Recall that Equations 1 (4.1) and 2 (4.2) from Linear Algebra: 
Introduction (Section 4.1) are 



x\ + X2 = 85 



3-1 

1.2 



(4.94) 



1.5-1.2 



The first step is to arrange each equation with all references to x\ in 
the first column, all references to xi in the second column, etc., and all 
constants on the right-hand side: 



x\ + X2 = 85 
0.3xi - 1.2x2 = 0. 



(4.95) 



Then the equations can be converted to a single matrix-vector equation. 
The coefficients form a matrix, keeping their same relative positions, and 
the variables and constants each form a vector: 



1 
0.3 



1 
-1.2 



Xl 

x 2 



85 




(4.96) 



Exercise 4.27 

Verify by the rules of matrix multiplication that the system of 
equations in 2 (4.95) in equivalent to the matrix equation in 3 
(4.96). 
Equation 3 (4.96) is of the general form 



where in this case 



Ax 



(4.97) 



1 
0.3 



1 
-1.2 





Xl 




85 


, x = 




, b = 






X2 








(4.98) 
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Given any A e ll nxn and b e ll n , MATLAB can solve Equation 4 (4.97) 
for x (as long as a solution exists). Key ideas in the solution process are 
the identity matrix and the inverse of a matrix. 

When the matrix A is the lxl matrix a, the vector x is the 1-vector 
x, and the vector b is the 1-vector b, then the matrix equation Ax = b 
becomes the scalar equation 

ax = b. (4.99) 

The scalar a -1 is the inverse of the scalar a, so we may multiply on both 
sides of Equation 6 (4.99) to obtain the result 



a 1 (ax) = a x b 
lx = a~ 1 b. 



(4.100) 



We would like to generalize this simple idea to the matrix equation Ax = 
so that we can find an inverse of the matrix A. called A -1 , and write 



A- 1 (Ax) = A- l b 
I X = A~ x b. 
In this equation the matrix / is the identity matrix 



(4.101) 



1 





. 


. 





1 


. 


. 








1 . 


. 








. 


. 1 



(4.102) 



It is clear that the identity matrix / and the inverse of a matrix, A -1 , 
play a key role in the solution of linear equations. Let's study them in 
more detail. 

The Matrix Identity. When we multiply a scalar by 1, we get 
back that same scalar. For this reason, the number 1 is called the multi- 
plicativeidentity element. This may seem trivial, but the generalization 
to matrices is more interesting. The question is, is there a matrix that, 
when it multiplies another matrix, does not change the other matrix? The 
answer is yes. The matrix is called the identity matrix and is denoted by 
/. The identity matrix is always square, with whatever size is appropri- 
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ate for the matrix multiplication. The identity matrix has l's on its main 
diagonal and O's everywhere else. For example, 



10 
10 
10 
10 
1 



(4.103) 



The subscript 5 indicates the size. In terms of the unit coordinate vectors 
ei, we can also write the n x n identity matrix as 



In 



ei e 2 



For any matrix A s lZ nxp , we have 



(4.104) 



A = I n A. (4.105) 

For p = 1, we obtain the following special form for any vector x € H n : 



This last equation can be written as the sum 



(4.106) 



E 



Xi&i. 



(4.107) 



This is a special case of one of the results you proved in Exercise 3 
from "Linear Algebra: Matrices" (Exercise 4.24). Figure 1 (Figure 4.20) 
illustrates Equation 14 (4.107) and shows how the vector x can be broken 
into component vectors a;,ej, each of which lies in the direction of one 
coordinate axis. The values of the x\s are the coordinates of x, and their 
magnitudes are also the lengths of the component vectors. 
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x,e 




■■'x 2 Q2 



Figure 4.20: Breaking a Vector into Components 



Exercise 4.28 

Use Equation 13 (4.106) and the rules for matrix multiplication 
to show that x € lZ n may also be written as 



/ ^ (,3-; &i) &i' 



(4.108) 



This verifies Equation 11 from "Linear Algebra: Direction Cosines" (4.36). 
When the product of two numbers is 1 (the identity element), we say 
that they are inverses of each other, like 2 and 0.5. Likewise, we say 
that two square matrices are inverses of each other if their product is the 
identity matrix: 

AB = I^B = A-\ (4.109) 

An interesting and useful result is implied by this definition. Take the 
first form of Equation 16 (4.109) and multiply by B from the left: 



AB = I 

B {AB) = BI 

{BA)B = B 

BA = I. 



(4.110) 



We emphasize that the inference made in the last step here is only valid 
when B and A are square matrices. The result means that, even though 
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matrix multiplication is not commutative in general, we have a special 
case where it is commutative. If A and B are inverses of each other, then 

AB = BA = I. (4-111) 

Exercise 4.29 

Prove that the inverse of the 2 x2 rotation matrix R(0) is 
R T {6). 

Matrices that are not square do not have inverses. In fact, not all square 
matrices have inverses. So it becomes an important issue to determine 
which matrices do have inverses. If a matrix has an inverse, the inverse is 
unique. If a square matrix has no inverse, it is called a singular matrix. 
The determinant of a square matrix is a scalar computed from the num- 
bers in the matrix. It tells us whether a matrix will have an inverse or not. 
A matrix is singular if and only if its determinant is zero. 11 In MATLAB, 
the notation det(A) is used to compute the determinant. Whenever the 
matrix A in Equation 4 (4.97) is singular, it means one of two things 
about the system of equations represented: either the equations are in- 
consistent and there is no solution, or the equations are dependent and 
there are infinitely many solutions. 

Solving Ax = b. Let's now study ways to solve the matrix equation 
Ax = b. We will assume that a unique solution for x exists. Thus a 
unique matrix A -1 exists with the property A~ x A = /. The trick is to 
find it. Here is one procedure. 

For convenience, rewrite the matrix equation Ax = b as 



[Ab] 



x 
-1 



(4.112) 



The matrix [Ab] € TZ nx ( n + 1 ) is called the augmented matrix for the sys- 
tem of equations. The augmented matrix may be viewed as a systematic 
way of writing all the information necessary to solve the equations. 

The advantage of Equation 19 (4.112) is that we may premultiply 
both sides by any matrix C\ (of compatible size), and the right-hand side 
remains zero (although this is equivalent to multiplying on both sides of 
Equation 4 (4.97), which some may prefer). We can repeat this operation 



n It is not important now to understand how the determinant is defined and com- 
puted from the elements of a matrix. In your more advanced courses you will study 
the determinant in some detail. 
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as often as we like with matrices C 2 , C3, etc. The general result is 



[C m ■ ■ ■ C 2 C\AC m ■ ■ ■ C 2 C\b\ 



-1 



0. 



(4.113) 



Now suppose that we have found a sequence of matrices Ci, ... , C m that 
transforms the matrix A to the identity matrix: 

C m ■ ■ ■ C2C1A = I. The augmented matrix equation in 20 (4.113) sim- 
plifies to 



[IC m ■ ■ ■ C 2 C 1 b] 



-1 



which can be multiplied out to reveal that the solution for x is 

x = C m ■ ■ ■ C 2 C 1 b. 
The method may be summarized as follows: 



(4.114) 



(4.115) 



i. form the augmented matrix [Ab] for the system; 

ii. premultiply [Ab] by a sequence of selected matrices Ci, designed to 
take A to 7; and 

iii. when A is transformed to I, b will be transformed to x, so the solu- 
tion will appear as the last column of the transformed augmented 
matrix. 

We may also conclude that the product of the matrices C; must be the 
inverse of A since A~ l is the unique matrix for which A~ l A = I. In 
solving for x by this method, we have found A -1 implicitly as the product 

C m ■ ■ ■ C 2 C\. 



Example 4.9 

Consider the equation 












3 1 




Xi 




6 




2 4 




X2 




5 



A x = b. 
The augmented matrix for this equation is 



[Ab] 



3 1 6 

2 4 5 



(4.116) 
(4.117) 

(4.118) 
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Now if we could add —2/3 times the first row to the second row, 
we would get in the lower left corner. This is the first step in 
transforming A to the identity I. We can accomplish this row 
operation with the matrix 



Ci 



Ci [A b] 



1 




2/3 1 




3 1 6 


10/3 


1 



(4.119) 



(4.120) 



Now adding —3/10 times the new second row to the first row 
will introduce in the (1,2) position, bringing us closer still to 
the identity. Thus 



Co 



C 2 d [A b] 



1 -3/10 
1 




3 

10/3 


57/10 
1 



(4.121) 



(4.122) 



We now complete the transformation to identity by normalizing 
each row to get the needed l's: 



C, 



1/3 
3/10 



CsCzd [Ab] 



1 19/10 
1 3/10 

According to the last column, the solution is 

19/10 
3/10 



(4.123) 



(4.124) 



(4.125) 



We note in passing that the inverse of A is the product of the 

C's, so 
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C3C2C1 



1/3 




1/3 
3/10 

-1/10 
3/10 



1 


1 

-2/3 



-3/10 
1 


1 



1 

-2/3 1 



2/5 
-1/5 



The method we have just used, combined with a particular way of choosing 
the Ci matrices, is called Gauss elimination. Gauss elimination requires 
less computation than finding the inverse of A because only the effect of 
A -1 on the specific vector b is computed. MATLAB can solve for x by 
either method, as shown in Demo 4.2. For hand computations, we suggest 
choosing the Cj matrices so that C\ produces O s everywhere below the 
diagonal in the first column, C2 produces O s below the diagonal in the 
second column, and so on up to C n -i- Then C n produces O s above the 
diagonal in the n column, C n +i produces O s above the diagonal in 
column n— 1, etc. The last one, C^n-i, normalizes the diagonal elements 
to l's. We have assumed for simplicity that no O s on the diagonal will 
be encountered in hand computations. 

Exercise 4.30 

Check that A" 1 A = I in Example 1 (Example 4.9) 

Exercise 4.31 

Augment Equation 3 (4.96) as in Equation 19 (4.112) and use 
the technique of Gauss elimination to solve for x. 

Demo 1 (MATLAB). From the command level of MATLAB, solve 
the matrix equation of Example 1 from "Linear Algebra: Introduction" 
(Example 4.1) by typing 



> A = [1 1;0.3 
> b = [85 ;0] 



-1.2] 



You have entered the matrices A and b, which describe the problem. You 
can now solve for x by finding the inverse of A and multiplying b: 

> x = inv(A) * b 

In this example the inverse is computed quickly because A is a small 
matrix. For a large (say, 30 x 30) matrix, the answer would take longer 
to compute, and the more efficient method of Gauss elimination would 
reduce waiting time. You can use Gauss elimination in MATLAB by 
typing 



-1/10 
3/10 



> x 



A \ b 
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You should get the same answer. Now type the MATLAB code required 
to compute Ax and to show Ax — 6=0. 

Exercise 4.32 

(MATLAB) Write the following system of equations as Ax = b 
and solve using MATLAB: 

3(x 1 -x 3 ) + 2{x 2 - l)-6 = x 3 (4.126) 

4x 3 = 7x 2 -5 (4.127) 

6(xi + x 2 + 2) =x 3 +l. (4.128) 



4.9 Linear Algebra: Circuit Analysis 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In this section we use the linear algebra we have developed to find the 
voltages and currents in a simple electrical circuit, such as the one shown 
in Figure 1 (Figure 4.21). There are many reasons why this might be 
necessary; in this example we need to know the current flowing through 
the lamp to tell whether or not it will glow. Too little current will have no 
visible effect; too much current will cause the lamp to burn out. We will 
apply a few physical laws relating the voltages and currents in a circuit, 
turn these laws into systems of linear equations, and solve the equations 
for the voltages and currents. 



2 This content is available online at <http://cnx.Org/content/m21447/l.8/>. 
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-WM t VWW- 



5(J $300 §2 (lamp) 



Figure 4.21: A Simple Electrical Circuit 



Current, Voltage, and Resistance. We will use three physical 
quantities in our analysis of electrical circuits: current, voltage, and resis- 
tance. Current is the flow of electrical charge from one place to another. 
Electrons flowing through a wire or through some other electronic device 
comprise a current. Voltage is a difference in electric potential that makes 
electrons flow. Voltage is sometimes called electromotive force because it 
is like a "force" that moves electrons. Resistance is a property of the de- 
vice through which the electron current flows. The lower the resistance 
of a device, the more easily current can flow through the device. 

The analogy of water flowing through pipes can help you develop in- 
tuition about electrical circuits. In this analogy, electrical current corre- 
sponds to the flow rate of water. Voltage corresponds to the pressure that 
forces the water to flow, and resistance is the friction of flow. A small 
pipe would impede the flow of water more than would a large pipe, so the 
small pipe would correspond to a higher resistance. While this analogy 
can be helpful, keep in mind that electricity is not water. All analogies 
break down at some point. 

We measure electrical current in amperes. The standard symbol for 
current is i, and the direction of positive flow is indicated by an arrow on 
the circuit diagram. The arrow is for reference only; if the true current is 
in the opposite direction, we get negative values for i. Because electrons 
are negatively charged, current is defined as flowing in the opposite di- 
rection as electron motion. But to reduce confusion, you should learn to 
think in terms of current rather than electron motion. 

A point in a circuit where several devices are connected together is 
called a node. The conservation law for current says that "what flows in 
must flow out of a node," a principle known as Kirchhoff's current law. 
Kirchhoff's current law states that the sum of all currents leaving a node 
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is zero. In this law, a current entering the node is considered to be a 
negative current leaving the node. 

Voltage is measured in volts and is usually written as v (or e). Since 
voltage is a difference in potential between two points (nodes), we can 
show it on a circuit diagram with a +and a -sign to indicate which two 
nodes we are comparing and which one of the nodes is considered negative. 
As with current, the markings are for reference only and we may end up 
with a negative value of v. 

In an electrical circuit, one node is usually chosen as a reference node 
and is considered to have a voltage of zero. Then the voltage at every 
other node is measured with respect to the reference node. This saves us 
the trouble of always specifying pairs of nodes for voltage measurements 
and marking + and - signs for each voltage. Other names for the reference 
node are common and ground. 

A constant voltage source is a device that always forces the voltage 
between its two terminals to be a constant value. In Figure 1 (Figure 4.21) 
the circle at the left represents a constant voltage source of 5 volts, so that 
the voltage at the upper (+) end is always exactly 5 volts higher than the 
voltage at the lower (-) end. A voltage source is something like a battery, 
but idealized. Real batteries do not maintain a constant output voltage 
under all conditions. 

Resistance is measured in ohms and is denoted by R. A resistor is 
shown as a zig-zag line in circuit diagrams and labeled with the value 
of its resistance in ohms. In this chapter we will consider only devices 
whose resistance is positive and the same in both directions. Ohm's law, 
also called the resistor law, relates the voltage and current in a resistor. 
For the resistor shown in Figure 2 (Figure 4.22), with reference directions 
assigned to v and i as shown, Ohm's law is 

v = iR. (4.129) 

Note that current flows from + to - through the resistor. 
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^MY 



^ v ■ 



Figure 4.22: Ohm's Law 



Example 4.10 

Ohm's law and Kirchhoff's current law are the only principles 
we need to write equations that will allow us to find the voltages 
and currents in the resistive circuit of Figure 1 (Figure 4.21). 
We begin by choosing a reference node and assigning variables 
to the voltages at every other node (with respect to the reference 
node). These choices are shown in Figure 3 (Figure 4.23). 



50 

-AA/WV- 



100 

-WWr 



50 



300 



'.2 (lamp) 



reference node 



Figure 4.23: Assigning Node Voltages 



The constant voltage source forces v\ to be exactly 5 volts 
higher than the reference node. Thus 



vi = 5. 



(4.130) 



Next we write equations by applying Kirchhoff's current law 
to each node in the circuit (except the reference node and v±, 
whose voltages we already know). At the node labeled V2 are 
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three paths for leaving current. The current leaving through the 
50 ohm resistor can be found by Ohm's law, where the voltage 
across that resistor is v 2 — V\ : 

H0 = R = ^0— (4 - 131) 

For current leaving through the 300 ohm resistor, the voltage 
is i>2- Pay careful attention to the sign; since we are interested 
in the current leaving the node labeled w 2 , Figure 4.14 indicates 
that to apply Ohm's law we should take the voltage as +«2— 
reference = v 2 — = vi. So 

i 300 = -?- (4.132) 

jou 30Q v ; 

For the 100 ohm resistor, we can write 

00 = — 100 — (4.133) 

According to Kirchhoff's current law, the sum of these three 
leaving currents is zero: 

("2— Vl) I VI I (D2-U3) _ r. 

50 ~ 300 ~ 100 u 

=> 6(v 2 -v 1 ) + V2+3(v2-v 3 )=0 (4.134) 

=4> -6vi + 10w 2 - 3w 3 = 0. 

Notice that when we wrote the equation for the node labeled 
V2, the variable V2 had a + sign each time it occurred in the 
equation, while the others had a -sign. This is always the case, 
and watching for it can help you avoid sign errors. Now we 
apply Kirchhoff's current law at the node labeled V3 to get the 
equation 

(v 3 -v 2 ) , V3 _ n 
100 " r 2 u 

=> (>3 - v 2 ) + 50w 3 = (4.135) 

=4> Ovi - lw 2 + 51w 3 = 0. 

Note that this time it is v$ that always shows up with a + sign. 

Equations 2 (4.130), 6 (4.134), and 7 (4.135) give us a system 

of three equations in the three unknown variables t>i,i>2, and V3. 
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We now write them in matrix form as 

1 

-6 10 -3 

-1 51 





Vl 




5 




V 2 


= 







. V 3 . 








(4.136) 



Exercise 4.33 

(MATLAB) Use MATLAB to solve Equation 8 (4.136). You 
should find 



V! = 5.0000 volts 



(4.137) 



v 2 = 3.0178 volts 



(4.138) 



v 3 = 0.0592 volt. 



(4.139) 
Is the 



What is the determinant of the coefficient matrix A? 
solution unique? 

We can determine the current flowing through the lamp from v 3 to ground 
in Example 1 (Example 4.10) by Ohm's law: 



0.0296 ampere. 



(4.140) 



v v 3 
l= R = Y 

The visible effect will, of course, depend on the lamp. Let us assume 
that the specifications for our lamp indicate that 0.05 ampere or more is 
required before it will glow, and more than 0.075 ampere will cause it to 
burn out. In this case, our circuit would not make the lamp glow. 

Exercise 4.34 

(MATLAB) Write and solve equations for the circuit in Figure 
4 (Figure 4.24). What are the voltages at the nodes labeled v\ 
through «4? What is the current labeled i\ ? And i^l 
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Figure 4.24: A Resistive Network 



4.10 Linear Algebra: Numerical Experiment 
(Circuit Design) 13 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Our analysis in Example 1 from "Linear Algebra: Circuit Analysis" (Ex- 
ample 4.10) and Problem 1 from "Linear Algebra: Circuit Analysis" (Ex- 
ercise 4.33) indicates that not enough current will flow through the lamp 
to make it glow. We now wish to change the resistance of the 100 ohm 
resistor to a new value so that the lamp will glow. We replace 100 in 
the equations with an unknown resistance R. Equation 2 (4.130) is un- 
changed, but Equation 6 (4.134) becomes 



(v 2 -vi) 
50 



V2 

300 



(l> 2 -t> 3 ) 

R 



= 

6R (v 2 -v 1 ) + Rv 2 + 300 (v 2 - v 3 ) = 
-QRv x + (7R + 300) v 2 - 300w 3 = 0. 



(4.141) 



3 This content is available online at <http://cnx.Org/content/m21462/l.6/>. 
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Equation 7 from "Linear Algebra: Circuit Analysis" (4.135) becomes 



(V 3 -V 2 ) , ^3 

R "r" 2 







(4.142) 



=> 2{v 3 - v 2 ) + Rv 3 = 

=> Ovi - 2w 2 + (R + 2) v 3 = 0. 
The matrix form of these equations is 

1 [ vi 1 [ 5 

-6R 7R +300 -300 v 2 = • (4.143) 

-2 7? + 2 J [ v 3 J [ _ 

Write a MATLAB function file called builda to accept R as an input 
and return the matrix A in Equation 3 (4.143) as an output. The first 
line of your function file should be 

function A = builda (R) ; 

Now choose several values for R. For each choice, use your function builda 
and solve the resulting matrix equation Av = b for the voltages. Each 
time you choose a different R to build a different matrix A, check the 
determinant of A to be sure the equations have a unique solution: 

> det(A) 

Make a table of R and the corresponding values of ^3: 



R 



V3 



Figure 4.25 



Now add a column to your table for the current through the lamp 
i = W3/2. Add rows to your table until you have found a value of R for 
which the lamp will glow. ( i needs to be between 0.05 and 0.075 ampere.) 



Chapter 5 

Vector Graphics 



5.1 Vector Graphics: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 
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5.1.1 Notes to Teachers and Students: 

In this chapter we introduce matrix data structures that may be used 
to represent two- and three-dimensional images. The demonstration pro- 
gram (p. 169) shows students how to create a function file for creating 
images from these data structures. We then show how to use matrix 
transformations for translating, scaling, and rotating images. Projec- 
tions are used to project three-dimensional images onto two-dimensional 
planes placed at arbitrary locations. It is precisely such projections that 



lr This content is available online at <http://cnx.Org/content/m21491/l.6/>. 
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we use to get perspective drawings on a two-dimensional surface of three- 
dimensional objects. The numerical experiment (Section 5.8) encourages 
students to manipulate a star field and view it from several points in 
space. 

Once again we consider certain problems essential to the chapter de- 
velopment. For this chapter be sure not to miss the following exercises: 
Exercise 2 in "Two-Dimensional Image Transformations" (Exercise 5.2: 
Reflections), Exercise 1 in "Homogeneous Coordinates" (Exercise 5.5), 
Exercise 2 in "Homogeneous Coordinates" (Exercise 5.6), Exercise 5 in 
"Three-Dimensional Homogeneous Coordinates" (Exercise 5.11), and Ex- 
ercise 2 in "Projections" (Exercise 5.13). 

5.1.2 Introduction 

Pictures play a vital role in human communication, in robotic manufac- 
turing, and in digital imaging. In a typical application of digital imaging, 
a CCD camera records a digital picture frame that is read into the memory 
of a digital computer. The digital computer then manipulates this frame 
(or array) of data in order to crop, enlarge or reduce, enhance or smooth, 
translateor rotate the original picture. These procedures are called digi- 
tal picture processing or computer graphics. When a sequence of picture 
frames is processed and displayed at video frame rates (30 frames per 
second), then we have an animated picture. 

In this chapter we use the linear algebra we developed in The chapter 
on Linear Algebra (Section 4.1) to develop a rudimentary set of tools for 
doing computer graphics on line drawings. We begin with an example: 
the rotation of a single point in the (x, y) plane. 

Example 5.1 

Point P has coordinates (3, 1) in the (x,y) plane as shown in 
Figure 1 (Figure 5.1). Find the coordinates of the point P\ 
which is rotated 5 radians from P. 

6 
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P'(x',y') 




P(3,l) 



Figure 5.1: Rotating a Single Point in the (x,y) Plane 



To solve this problem, we can begin by converting the point 
P from rectangular coordinates to polar coordinates. We have 



v^+ 



!J 



10 



6 = tan" 1 (f ) w 0.3217 radian. 



(5.1) 



The rotated point P' has the same radius r, and its angle is 
+ §■ We now convert back to rectangular coordinates to find 
x' and y' for point P': 



x 
V 



r cos 
r sin 



lOcos (0.8453) w2.10 
lOsm (0.8453) w 2.37. 



(5.2) 



So the rotated point P' has coordinates (2.10, 2.37). 

Now imagine trying to rotate the graphical image of some complex object 
like an airplane. You could try to rotate all 10,000 (or so) points in the 
same way as the single point was just rotated. However, a much easier 
way to rotate all the points together is provided by linear algebra. In fact, 
with a single linear algebraic operation we can rotate and scale an entire 
object and project it from three dimensions to two for display on a flat 
screen or sheet of paper. 

In this chapter we study vector graphics, a linear algebraic method of 
storing and manipulating computer images. Vector graphics is especially 
suited to moving, rotating, and scaling (enlarging and reducing) images 
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and objects within images. Cropping is often necessary too, although it 
is a little more difficult with vector graphics. Vector graphics also allows 
us to store objects in three dimensions and then view the objects from 
various locations in space by using projections. 

In vector graphics, pictures are drawn from straight lines. 2 A curve 
can be approximated as closely as desired by a series of short, straight 
lines. Clearly some pictures are better suited to representation by straight 
lines than are others. For example, we can achieve a fairly good represen- 
tation of a building or an airplane in vector graphics, while a photograph 
of a forest would be extremely difficult to convert to straight lines. Many 
computer- aided design (CAD) programs use vector graphics to manipu- 
late mechanical drawings. 

When the time comes to actually display a vector graphics image, it 
may be necessary to alter the representation to match the display device. 
Personal computer display screens are divided into thousands of tiny rect- 
angles called picture elements, or pixels. Each pixel is either off (black) or 
on (perhaps with variable intensity and/or color). With a CRT display, 
the electron beam scans the rows of pixels in a raster pattern. To draw 
a line on a pixel display device, we must first convert the line into a list 
of pixels to be illuminated. Dot matrix and laser printers are also pixel 
display devices, while pen plotters and a few specialized CRT devices can 
display vector graphics directly. We will let MATLAB do the conversion 
to pixels and automatically handle cropping when necessary. 

We begin our study of vector graphics by representing each point in an 
image by a vector. These vectors are arranged side-by-side into a matrix 
G containing all the points in the image. Other matrices will be used 
as operators to perform the desired transformations on the image points. 
For example, we will find a matrix R, which functions as a rotation: the 
matrix product RG represents a rotated version of the original image G. 

5.2 Vector Graphics: Two-Dimensional Image 
Representation 3 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



2 It is possible to extend these techniques to deal with some types of curves, but we 
will consider only straight lines for the sake of simplicity. 

3 This content is available online at <http://cnx.org/content/m21495/!. 6/>. 
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Point Matrix. To represent a straight-line image in computer memory, 
we must store a list of all the endpoints of the line segments that comprise 
the image. If the point p = (xi,yi) is such an endpoint, we write it as 
the column vector 



P; 



X j 

Vi 



(5.3) 



Suppose there are n such endpoints in the entire image. Each point is 
included only once, even if several lines end at the same point. We can 
arrange the vectors p into a point matrix: 



G = \P1P2P3—Pn] 

Xi x 2 x 3 x n 

V\ V2 2/3 J/n 



(5.4) 



We then store the point matrix G e TZ 2xn as a two-dimensional array in 
computer memory. 

Example 5.2 

Consider the list of points 





Pi = (0,0) 


P 2 = (-1.5,5) 


P 3 = (4,2.3) 


P 4 =(4,-l). 


The corresponding point matrix is 


G = 


-1.5 4 4 
5 2.3 -1 



(5.5) 



(5.6) 



Line Matrix. The next thing we need to know is which pairs of points to 
connect with lines. To store this information for m lines, we will use a line 
matrix, H e lZ 2xm . The line matrix does not store line locations directly. 
Rather, it contains references to the points stored in G. To indicate a line 
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between points p, and pj, we store the indices i and j as a pair. For the 
k th line in the image, we have the pair 



hk 



jk 



(5.7) 



The order of i and j does not really matter since a line from pi to pj is 
the same as a line from pj to pi. Next we collect all the lines hk into a 
line matrix H: 



H 



n «2 «3 
h h h 



(5.1 



All the numbers in the line matrix H will be positive integers since they 
point to columns of G. To find the actual endpoints of a line, we look at 
columns i and j of the point matrix G. 

Example 5.3 

To specify line segments connecting the four points of Example 
1 (Example 5.2) into a quadrilateral, we use the line matrix 



Hi 



12 3 4 
2 3 4 1 



(5.9) 



Alternatively, we can specify line segments to form a triangle 
from the first three points plus a line from P3 to P4 : 



Hi 



12 3 3 
2 3 14 



(5.10) 



Figure 1 (Figure 5.2) shows the points G connected first by Hi 
and then by H 2 - 



169 




*\ 


y 


3 


1 


i 


4 



Figure 5.2: Two Sets of Lines 



Demo 1 (MATLAB). Use your editor to enter the following MAT- 
LAB function file. Save it as vgraphl.m. 

i unction~vgraphl~ (points , "lines) ; 
"/."vgraphl" (points , "lines) ~plots~th.e~points~as~* ' s~and 
y,~connects~the~points~with~specif ied~lines . ~The~points 
y,~matrix~should~be~2xN, ~and~th.e~lines~matrix~should~be~2xM. 
7,~The~f ield~of ~view~is~preset~to~ (-50,50) ~on~both~axes . 
'/. 

°/o~Written~by~Rich.ard~T. "Behrens, "October" 1989 
1 
m=length (lines) ; °/.~f ind~the~number~of 

"/."lines. 
axis( [-50~50~-50~50] ) °/ ~set~the~axis~ scales 

axis(' square' ) 

plot (points (1 , : ) , points (2, :),'*') °/.~plot~the~points~as~* 
hold~on 7,~keep~the~points . . . 

f or~i=i :m °/,~while~plotting~the 

"/."lines 

plot ( [points (1 , lines (1 , i)) "points (1 , lines (2, i) )] , . . 

[points(2,lines(2,lines(l , i) ) "points (2, lines (2, i))] , ' 



end 



hold~off 

After you have saved the function file, run MATLAB and type the follow- 
ing to enter the point and line matrices. (We begin with the transposes 
of the matrices to make them easier to enter.) 
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> G = 


[ 




0.6052 


-0 


4728; 


-0.4366 


3 


5555; 


-2.6644 


7 


9629; 


-7.2541 


10 


7547; 


12.5091 


11 


5633; 


12.5895 


15 


1372; 


-6.5602 


13 


7536; 


31.2815 


-7 


7994; 


38.8314 


-9 


9874; 


44.0593 


-1 


1537; 


38.8314 


2 


5453; 


39.4017 


9 


4594; 


39.3192 


15 


0932; 


45.9561 


23 


4158: 



> G = G' 



H = 


[ 


1 


2; 


2 


3; 


3 


4; 


4 


5; 


4 


7; 


5 


6; 


8 


9; 


9 


10; 


10 


ii; 


11 


12; 


12 


13; 


12 


14] 



> H = H' 

At this point you should use MATLAB's "save" command to save these 
matrices to a disk file. Type 

3> save dippers 

After you have saved the matrices, use the function VGRAPH1 to draw the 
image by typing 



> vgraphl(G,H) 
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The advantage of storing points and lines separately is that an object can 
be moved and scaled by operating only on the point matrix G. The line 
information in H remains the same since the same pairs of points are 
connected no matter where we put the points themselves. 

Surfaces and Objects. To describe a surface in three dimensions is a 
fairly complex task, especially if the surface is curved. For this reason, we 
will be satisfied with points and lines, sometimes visualizing flat surfaces 
based on the lines. On the other hand, it is a fairly simple matter to 
group the points and lines into distinct objects. We can define an object 
matrix K with one column for each object giving the ranges of points and 
lines associated with that object. Each column is defined as 



kj 



first 


point 


last 


point 


first 


line 


last 


line 



(5.11) 



As with the line matrix H, the elements of K are integers. 

Example 5.4 

Consider again Demo 1 (p. 169). We could group the points in 
G and the lines in H into two objects with the matrix 



K 



1 


8 


7 


IA 


1 


7 


6 


12 



(5.12) 



The first column of K specifies that the first object (Ursa Minor) 
is made up of points 1 through 7 and lines 1 through 6, and the 
second column of K defines the second object (Ursa Major) as 
points 8 through 14 and lines 7 through 12. 
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5.3 Vector Graphics: Two-Dimensional Image 
Transformations 4 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

We now turn our attention to operating on the point matrix G to produce 
the desired transformations. We will consider (i) rotation; (ii) scaling; 
(iii) and translation (moving) of objects. Rotation and scaling are done 
by matrix multiplication with a square transformation matrix A. If we 
call the transformed point matrix G new , we have 

[G new ] = [A] [G] . (5.13) 

We call A a matrix operator because it "operates" on G through matrix 
multiplication. In contrast, translation must be done by matrix addition. 

In a later section you will see that it is advantageous to perform all 
operations by matrix operators and that we can modify our image rep- 
resentation to allow translation to be done with a matrix operator like 
rotation and scaling. We will call the modified representation homoge- 
neous coordinates. 

Rotation. We saw in the chapter on linear algebra (Section 4.1) that 
the matrix that rotates points by an angle 9 is 



A = R{6) 



cost) 
sinO 



—sin9 
cosO 



(5.14) 



When applied to the point matrix G, this matrix operator rotates each 
point by the angle 6, regardless of the number of points. 

Example 5.5 

We can use the rotation matrix to do the single point rotation 
of the example from "Vector Graphics: Introduction" (Exam- 
ple 5.1). We have a point matrix consisting of only the point 
(3,1): 



G 



(5.15) 



4 This content is available online at <http://cnx.Org/content/m21409/l.6/>. 
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The necessary transformation matrix is R (9) with 6 = \ Then 
the rotated point is given by 



G, 



R ('I) a 



cos (f) 



■(f) 



— sin 
cos 



(I) 
(f) 



2.10 
2.37 



(5.16) 



Scaling. An object can be enlarged or reduced in each dimension inde- 
pendently. The matrix operator that scales an image by a factor of s x 
along the x-axis and s y along the y-axis is 



•^ \Sxi Sy 



s x 
s 



y 



(5.17) 



Most often we take s x = s y to scale an image by the same amount in 
both dimensions. 

Exercise 5.1 

Write out the following matrices. Simplify and give numerical 
answers to two decimal places: 

a. i?(f); 

b. 5(3,2); 
c fl(-f); 
d. S(-l,l). 

Exercise 5.2: Reflections 

What does 5 (-1,1) do? 5(1,-1)?5(-1, -1)? 5(1,1)? 
Exercise 5.3 

-1.5 4 4 



Given G 



and 



f find 



5 2.3 -1 
Gnew =R (#) G. Give numerical answers to two decimal places. 

Exercise 5.4 

Apply each of the transformations in Exercise 1 (Exercise 5.1' 
and 2 (Exercise 5.2: Reflections) to the image 



G 



112 2 12 3 4 

; h = 

12 2 1 2 3 4 1 

Sketch the original image and each transformation of it. 



(5.18) 



174 



CHAPTER 5. VECTOR GRAPHICS 



Translation. An object can be moved by adding a constant vector b to 

20 



every point in the object. For example, 



will move an object 



20 units to the right and 5 units down. We can write this in terms of the 
point matrix as 



Cnew — G + 61 

where 1 (read "the one-vector") is a vector of n l's: 

1 
1 



1 



(5.19) 



(5.20) 



In MATLAB, 1 may be obtained by ones(n,l). The outer product of b 
with 1 in Equation 7 (5.19) simply serves to make n copies of b so that 
one copy can be added to each point in G. 



5.4 Vector Graphics: 
Transformations 5 



Composition of 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Often we will want to perform several operations on an object before we 
display the result. For example, suppose we want to rotate by ^ and 
reduce to \ size in each dimension: 



G\ = R ( ,- ) G 

^new — *^ \2' 2/ 1 



(5.21) 



If there are n points in the matrix G, it will require An multiplications 
to perform each of these operations, for a total of 8n multiplications. 



5 This content is available online at <http://cnx.Org/content/m21489/l.6/>. 



However, we can save some multiplications by noting that 

1 r 



Gr, 



S 



2' 2 



ftlgk'l = sr; 
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(5.22) 



where 



s(hk)R(l) 



t sin 



(I) 
(f) 



-(f) 
(I) 



(5.23) 



In other words, we take advantage of the fact that matrix multiplication 
is associative to combine S and R into a single operation A, which requires 
only 8 multiplications. Then we operate on G with A, which requires An 
multiplications. By "composing" the two operations, we have reduced the 
total from 8n to An + 8 multiplications. Furthermore, we can now build 
operators with complex actions by combining simple actions. 

Example 5.6 

We can build an operator that stretches objects along a diagonal 
line by composing scaling and rotation. We must 

i. rotate the diagonal line to the x-axis with R(— 9); 
ii. scale with S (s, 1); and 
iii. rotate back to the original orientation with R (9). 

Figure 1 (Figure 5.3) shows a square being stretched along a 
45° line. The composite operator that performs this directional 
stretching is 



A($,s) 

cosO —sinO 
sinO cosO 



R(9)S(s,l)R{- 



(5.24) 



s 
1 



cosO sinO 
—sinO cosO 



scos 2 + sin 2 (s — 1) sinOcosQ 
(s — 1) sinOcosQ cos 2 9 + ssin 2 9 



Note that the rightmost operator in a product of operators 
is applied first. 
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-'45° 





Figure 5.3: Rotating and Scaling for Directional Stretching 



5.5 Vector 
Coordinates 6 



Graphics: 



Homogeneous 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In the previous section we were able to combine rotation and scaling into 
a single composite operation by matrix multiplication. Unfortunately, 
translation cannot yet be included in the composite operator since we do 
it by addition rather than by multiplication. 

Example 5.7 

Suppose we wish to rotate the image G by ^ about the point 
(—10,10). Our rotation matrix R (6) always rotates about the 



6 This content is available online at <http://cnx.Org/content/m21490/l.6/>. 
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origin, so we must combine three transformations to accomplish 
this: 

i. translate the point ( — 10, 10) to the origin; 
ii. rotate ^ radians about the origin; and 
iii. translate the origin back to (—10, 10). 



For step (i), we have 6q 



and 



/0 

-10 
G 1 = G + b a l T 



For step (ii), 



Go 



i?(§) Gi 

tf(f)[G + M T ] 

i?(|)G + i?(f)6 l 3 



(5.25) 



(5.26) 



For step (iii), we can use — bo from step (i): 

Gnew = G2 — 60 1 

= i?(f)G + i?(f)&ol T -M T 

= ^(f)G+[(i?(f)-/)Mi T - 



(5.27) 



In this example we were unable to find a single matrix operator 
A to do the entire job. The total transformation took the form 



^ne 



AG + bV 



(5.28) 



This is called an affine transformation because it involves both multipli- 
cation by A and addition of a constant matrix. This is in contrast to the 
more desirable linear transformation, which involves only multiplication 
by A 

We will now move toward a modified representation of the image and 
the operators by rewriting the last equation as 



G new = [Ab] 
where in the example we had A = R (^) and b = (i? (^) — /) b . 



G 
1 T 



(5.29) 
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Exercise 5.5 

Show that, for any matrices A, B, C, D of compatible sizes, 



The matrix 



G 

1 T 



AB + CD = [A C] 



looks like 



B 
D 



(5.30) 



X\ x 2 x n 

Vl V2 Vn 

1 1 1 



(5.31) 



and the points (xi,yi,l) are called homogeneous coordinates. We can 
modify Equation 5 (5.29) so that the new point matrix is also in homo- 
geneous coordinates: 



G 



1 



new 
T 



A 
T 



1 



G 
1 T 



(5.32) 



In the new representation, each point in the image has a third coordinate, 
which is always a 1. The homogeneous transformation is a 3 x 3 matrix, 



A 
T 



1 



(5.33) 



which is capable of translation, rotation, and scaling all by matrix multi- 
plication. Thus, using homogeneous coordinates, we can build composite 
transformations that include translation. 
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In homogeneous coordinates, we have 
R(6) = 



cosO —sinO 

sinO cosO 

1 

s x 



<J \S X 1 Sy) 



-L \txi ty 



Sy 

1 

1 i x 

1 ty 

1 



(5.34) 



Example 5.8 

The composite transformation to triple the size of an image and 
then move it 2 units to the left is 



A 



1 


-2 




3 




3 




1 







3 


= 


3 








I 




1 







1 



(5.35) 



On the other hand, the composite transformation to move an 
image 2 units to the left and then triple its size is 



B 



3 
3 
1 



1 
1 




3 





-( 





3 











1 



6 



(5.36) 



In the latter case, the distance of the translation is also tripled. 

Exercise 5.6 

Find a single composite transformation in homogeneous coor- 
dinates that rotates an image by angle 8 about point (xi,j/j) as 
in Example 1 (Example 5.7). 
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5.6 Vector Graphics: Three-Dimensional Ho- 
mogeneous Coordinates 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

We now consider the storage and manipulation of three-dimensional ob- 
jects. We will continue to use homogeneous coordinates so that transla- 
tion can be included in composite operators. Homogeneous coordinates in 
three dimensions will also allow us to do perspective projections so that 
we can view a three-dimensional object from any point in space. 

Image Representation. The three-dimensional form of the point 
matrix in homogeneous coordinates is 



G = { 



Xi 


Xi 


X 3 . 


X 


m 


yi 


2/3 • 


■ V 


Z\ 


Z-2 


Z3 ■ 


. z 


1 


1 


1 . 


. 1 



} en 4 



(5.37) 



The line matrix H is exactly as before, pointing to pairs of columns in G 
to connect with lines. Any other grouping matrices for objects, etc., are 
also unchanged. 

Image manipulations are done by a 4 x 4 matrix A. To ensure that the 
fourth coordinate remains a 1, the operator A must have the structure 



an 0-12 «13 a 14 

^21 0,22 «23 a 24 

^31 032 033 &34 

1 

The new image has point matrix 



(5.38) 



G ,, 



AG. 



(5.39) 



7 This content is available online at <http://cnx.Org/content/m21494/l.6/>. 
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Exercise 5.7 

If the coordinates of the i th point in G are (xi,yi,Zi, 1), what 
are the coordinates of the i th point in G new = AG when A is as 
given in Equation 2 (5.38)? 

Exercise 5.8 

Write down the point matrix G for the unit cube (the cube with 
sides of length 1, with one corner at the origin and extending in 
the positive direction along each axis). Draw a sketch of the 
cube, numbering the vertices according to their order in your 
point matrix. Now write down the line matrix H to complete 
the representation of the cube. 

Left- and Right-Handed Coordinate Systems. In this book we work 
exclusively with right-handed coordinate systems. However, it is worth 
pointing out that there are two ways to arrange the axes in three dimen- 
sions. Figure 1(a) (Figure 5.4) shows the usual right-handed coordinates, 
and the left-handed variation is shown in Figure 1(b) (Figure 5.4). All 
possible choices of labels x,y, and z for the three coordinate axes can be 
rotated to fit one of these two figures, but no rotation will go from one to 
the other. 



(a) (b) 

Figure 5.4: Three-Dimensional Coordinate Systems; (a) Right- 
handed, and (b) Left-handed 



Be careful to sketch a right-handed coordinate system when you are 
solving problems in this chapter. Some answers will not be the same for 
a left-handed system. 

Image Transformation. Three-dimensional operations are a little 
more complicated than their two-dimensional counterparts. For scaling 
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and translation we now have three independent directions, so we gener- 
alize the operators of Equation 10 from "Vector Graphics: Homogeneous 
Coordinates" (5.34) as 



»-* \Sxj Syi S z) 



-L \^x ?tyjt Z 



s x 
s,. 



r ° S V ° ° , 
{ } 

s z 



1 

1 t x 

1 ty 

1 t z 

1 



(5.40) 



Exercise 5.9 

Show that T(-t x , 



-t y , —t z ) is the inverse of T (t x , t y , t z ) . T 



undoes the work of T. 

Rotation may be done about any arbitrary line in three dimensions. We 
will build up to the general case by first presenting the operators that 
rotate about the three coordinate axes. R x (0) rotates by angle 9 about 
the x-axis, with positive going from the y-axis to the z-axis, as shown 
in Figure 2 (Figure 5.5). In a similar fashion, positive rotation about the 
y-axis using R y (8) goes from z to x, and positive rotation about the z-axis 
goes from x to y, just as in two dimensions. We have the fundamental 



rotations 
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Rx (P) = { 



Ry (6) = { 



R z (9) = { 



1 










cos6 


. 


-sinO 





sin6 




COS0 













1 


cosO 





sinO 








1 








—sinO 





cos8 














1 


cosO 


sin8 





sinO 


zos 


9 











1 














1 



(5.41) 



A more general rotation about any line through the origin can be con- 
structed by composition of the three fundamental rotations. Finally, by 
composing translation with the fundamental rotations, we can build an 
operator that rotates about any arbitrary line in space. 



X' 



^R x (0) 



R v (8) , 



y y 

X' 



y 



X' 



~* y 

R-(0) 



Figure 5.5: Directions of Positive Rotation 



Example 5.9 

To rotate by angle </> about the line C, which lies in the x — y 
plane in Figure 3 (Figure 5.6), we would 



184 



CHAPTER 5. VECTOR GRAPHICS 



i. rotate C to the x-axis with R z (—9); 
ii. rotate by <j> about the x-axis with R x (0); and 
iii. rotate back to C with R z (8). 

The composite operation would be 

A(9,<j>) = R z (0)R x (<j>)R x (-6). 



(5.42) 




y 



Figure 5.6: Composition of Rotations 



Direction Cosines. As discussed in the chapter on Linear Algebra 
(Section 4.1), a vector v may be specified by its coordinates (x,y,z) or 
by its length and direction. The length of v is \\v\\, and the direction 
can be specified in terms of the three direction cosines ( cosO x , cosO y , 
cosOz). The angle 9 X is measured between the vector v and the x-axis or, 
equivalently, between the vector v and the vector e x =[100] . We have 



cost 



{v,e x ) 



x 

W\ 



(5.43) 
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Likewise, 9 y is measured between v and e y = [010] , and 9 Z is measured 
between v and e z = [001] . Thus 



COSOy — | 1^ | 

COS # z = tAtt 

\m\ 



(5.44) 



The vector 



cos9 x 
u = { cosd y } (5.45) 



cos9 z 
is a unit vector in the direction of v, so we have 



v = \\v\\u=\\v\\{ cosOy). (5.46) 

cos9 z 

Exercise 5.10 

Show that u is a unit vector (i.e. 1 u|| = 1). 

The direction cosines are useful for specifying a line in space. Instead of 
giving two points Pi and Pi on the line, we can give one point P\ plus 
the direction cosines of any vector that points along the line. One such 
vector is the vector from Pi to P 2 . 

x 
Arc tangents. Consider a vector v = { } in two dimensions. We 

y 

know that 

tanO = - (5.47) 

x 

for the angle 9 shown in Figure 4 (Figure 5.7). If we know x and y, we 
can find 9 using the arc tangent function 

9 = tan- 1 ^Y (5.48) 
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II 




X 



IV 



Figure 5.7: Tangent and Arc Tangent 



In MATLAB, 

theta = atan(y/x) 

Unfortunately, the arc tangent always gives answers between =^- and | 
corresponding to points v in quadrants I and IV. The problem is that the 

ratio 5^ is the same as the ratio xA so quadrant III cannot be 

distinguished from quadrant I by the ratio - Likewise, quadrants II and 
IV are indistinguishable. 

The solution is the two-argument arc tangent function. In MATLAB, 

theta = atan2(y,x) 

will give the true angle 8 —n and ir in any of the four quadrants. 

Example 5.10 

cos6 x 
Consider the direction vector u = { cosO y }, as shown in Figure 

cos8 z 
5 (Figure 5.8). What is the angle <f> y between the projection of 
u into the x — y plane and the y-axis? This is important because 
it is R z (0J,) that will put u in the y — z plane, and we need to 
know the angle y in order to carry out this rotation. First note 
that it is not the same as 9 y . From the geometry of the figure, 
we can write 



tari(f>y 



cos6 x 
cos9„ 



(5.49) 
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This gives us a formula for <f> y in terms of the direction cosines 
of u. With the two-argument arc tangent, we can write 



<p y = tan (cos9 x ,cos9y) 



(5.50) 




Figure 5.8: Angles in Three Dimensions 



Exercise 5.11 



Suppose point p' is in the y — z plane in three dimensions, 
p = (0, y ," , l). Find 9 so that R x (9) will rotate p' to the 
positive z-axis. (Hint: Use the two-argument arc tangent. 
9 will be a function of y' and z .) 

Let p be any point in three-dimensional space, p = 
(x, y, z, 1). Find ip so that R z (t/j) rotates p into the y — z 
plane. (Hint: Sketch the situation in three-dimensions, 
then sketch a two-dimensional view looking down at the 
x — y plane from the positive z-axis. Compare with Ex- 
ample 2 (Example 5.10).) Your answers to parts (a) and 
(b) can be composed into an operator Z (p) that rotates a 
given point p to the positive z-axis, Z (p) = R x (9) R z (ip). 
Let £ be a line in three-dimensional space specified by a 
point 1 =(x, y, z, 1) and the direction cosines ( cos9 x , cos9 y , 
cos9 z ). Use the following procedure to derive a composite 
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operator R (<f>, C) that rotates by angle cj> about the line £: 

i. translate 1 to the origin; 
ii. let u =( cos9 x , cos6 y , cos9 z , 1) and use Z (u) to align 

C with the z-axis; 
iii. rotate by <f> about the z-axis; 
iv. undo step (ii); and 
v. undo step (i). 



5.7 Vector Graphics: Projections 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Computer screens and printers are two-dimensional display devices. We 
must somehow convert three-dimensional images to two dimensions in or- 
der to display them. This task is done by another kind of matrix operator 
called a projection. 

To build a projection, we first choose a projection plane in the three- 
dimensional space of the object we wish to view. All points of the object 
are then projected onto the plane. There are many different kinds of 
projections, corresponding to various geometric rules for mapping points 
in space onto a plane. We begin with the parallel projection illustrated 
in Figure 1 (Figure 5.9), wherein the dotted lines between the points and 
their projections in the plane are all parallel to one another. These dotted 
lines are called projectors. 

Range. The projection plane is called the range of the projection. We 
will assume for now that the projection plane passes through the origin. 
If it does not, we may later compose the necessary translations with our 
projection. Three points, not all in a line, are required to determine a 
plane. We will take the origin as one of the points and suppose that the 
other two points are the vectors r\ and r 2 - From these vectors, we form 
the matrix 

R=[r 1 r 2 ], (5.51) 



3 This content is available online at <http://cnx.Org/content/m21493/l.6/>. 
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which determines the range of the projection. 



50 
40 - 




-50 



40 -30 -20 -10 10 20 30 40 50 



Figure 5.9: Oblique Parallel Projection 



Null-Space. To complete the specification of the parallel projection, 
we must specify the direction of the projectors. The line through the 
origin in this direction is called the null-space of the projection. Note 
that any line in the three-dimensional object that is parallel to the null- 
space will disappear to a point when projected. The null-space may be 
specified by a vector n pointing in the direction of the projectors. 

Orthogonal Projection. If the null-space is perpendicular to the 
range, we say that the projection is an orthogonal projection. The matrix 
operator for orthogonal projection is a function of the range. If we assume 
that R is specified in three-dimensional coordinates (not homogeneous!), 
we have the following definition for the orthogonal projection onto the 
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range of R: 



! D T 



P (R) = R(R T R) R T e TZ 



>3x3 



(5.52) 



In homogeneous coordinates, we embed this 3x3 projection matrix in 
the general 4x4 transformation: 



Ph (R) 



P{R) 



i 



1 



(5.53) 



Example 5.11 

Suppose we choose the x — y plane as our projection plane. 
Vectors n and r^ can be any two points in the plane (besides 
the origin), so let's take 



n 



1 




1 





> r 2 = 


1 











(5.54) 



Then the range matrix is 



R 



1 


1 





1 









(5.55) 



The orthogonal projection looking down on the x — y plane from 
the z-axis is 



P(R) 



1 1 




/ 


1 











I 



1 
1 




1 
1 1 





1 1 


\ 


-1 




1 











) 





1 

(5.56)= 
1 1 
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In homogeneous coordinates, 



Ph(R) 



10 

10 



1 



(5.57) 



Exercise 5.12 



Let the vectors r\ 



and ri 



specify the range 



of an orthogonal projection. Find P (R) and Ph(R). Compare 
with Example 1 (Example 5.11) and explain any similarities. 

Example 5.12 

In the chapter on linear algebra (Section 4.1) you learned that 
the projection of w onto x is given by 



(x, w) X 
(x,x) 



(5.58) 



This is an orthogonal projection of w onto a line, but it is closely 
related to the projection into the plane just described. To see 
the similarity, let's work on the expression for z a little: 



(x,x) 

x(x,x) (x,w) 
x(x T x) [X T Wj 
(x T x) x T w 
P (x) w. 



(5.59) 



So we see that it can be written in the same way as the projection 
onto the plane. The only difference is that the range is now one- 
dimensional and specified by x in place of R. 

Oblique Projection. More generally, we may have a null-space n that 
is not perpendicular to the range R. The projection shown in Figure 1 
(Figure 5.9) is an oblique projection. Once again we start with nonhomo- 
geneous coordinates for n and R and write the 3x3 oblique projection 
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E (R, n) = R{R T [I - -P (n)] Ry 1 R T [I - -P (n)] (5.60) 

where 



P(n) = n(n T n) n T = ^ (5.61) 



As with the orthogonal projection, we can return to homogeneous coor- 
dinates by 



E h (R,n) 



E{R n 
T 1 



(5.62) 



Exercise 5.13 

Prove and interpret the following properties of parallel projec- 
tions (both orthogonal and oblique): 

a. P 2 = P;E 2 = E. 

b. PR = R;ER = R. 

c. En = 0; Pn = 0. (First show that R T n = when n is 
orthogonal to R.) 

Display from Projections. Even after we have used a projection, the 
image points are in three-dimensional homogeneous coordinates. How 
then do we display them on a two-dimensional display? If we had chosen 
the x — y plane as the range of our projection, we could let the output 
device represent the x — y plane and ignore the z-coordinate of each point. 
The z-coordinates of the projected image would all be anyway since the 
projected points would lie in the x — y plane. The fourth coordinate of 1 
may also be ignored for display. But even if the projection plane is not 
the x — y plane, we may perform a rotation to align the two planes and 
again let the output device represent the x — y plane. 

Perspective Projections. To obtain a perspective projection, we 
first choose a projection plane as we did for parallel projections. Instead of 
choosing a null-space parallel to all projectors, we now choose a viewpoint. 
The projectors all pass through the viewpoint in a perspective projection, 
as shown in Figure 2 (Figure 5.10). For a viewpoint at z = d on the 
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z-axis and a projection plane coinciding with the x — y plane, the three- 
dimensional homogeneous operator for perspective projection is 



M(d) 



10 






1 


























-1 

,7 


1 



(5.63) 



The first thing you should notice about the perspective projection M (d) 
is that it violates the structure given in Equation 2 from "Vector Graph- 
ics: Three-Dimensional Homogeneous Coordinates" (5.38) by having the 
4,3 position equal to —h rather than to 0. This means that the fourth 



■h rather than to 

a 

coordinates will not remain 1 in the new point matrix 



& n 



M{d)G. 



(5.64) 
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G new = M(d)G. 




40 -30 -20 -10 10 20 30 40 50 



Figure 5.10: A Perspective Projection 



This situation is interpreted to mean that the new point (x,y,z,w) 
must be renormalized to ( — ,— — l) before the operation is considered 
complete. Renormalization adds another computational step to the im- 
age transformation process. This is undesirable, but we are stuck with it 
if we wish to include perspective projections in our repertoire of transfor- 
mations. Note that renormalization is a point-by-point process since w 
may be different for each point. 

How does renormalization affect composition of operators? We might 
expect that, each time we perform an operation requiring renormalization, 
we will be forced to stop and do the renormalization before going on with 
other operations. In this respect we are fortunate: we may put off the 
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renormalization until all transformations are complete and renormalize 
once just before displaying the image. Thus we are able to compose 
perspective projections at will with other transformations. 

Exercise 5.14 

What is the perspective projection matrix for a viewpoint at 
infinity, M (oo)? Interpret the result. 

Generalization of Projections. "Projection" is a technical term in lin- 
ear algebra. A square matrix of any size is considered a projection if it 
obeys the property of Exercise 2(a) (Exercise 5.13), P 2 = P. All of our 
geometric projection matrices have this property. We have considered 
only three-dimensional spaces with a two-dimensional range and a one- 
dimensional null-space. In general, the dimensionality of the space may 
be split in any way between range and null-space. If we reinterpret homo- 
geneous coordinates as four-dimensional space, we have projections with 
three-dimensional range and one-dimensional null-space, but the perspec- 
tive projection is actually not quite a projection in the technical sense 
even though M 2 (d) = M (d) because perspective projection also includes 
renormalization. 

5.8 Vector Graphics: Numerical Experiment 
(Star Field) 9 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

With Earth at the origin, we may specify the star positions for the Big 
and Little Dippers in three-dimensional homogeneous coordinates. With 
light years as our units, we have G T = 





1.5441~~ 


1. 


0386 : 


8. 


7955 : 


12 


.8807 


18 


.8926 


45 


.1364 . 


9. 


6222 : 



-1.2064 153.0875 1.0000 

8.4588 142.7458 1.0000 

26.2870 198.0698 1.0000 

19.0964 106.5383 1.0000 

17.461 90.6185 1.0000 

54.2706 215.1148 1.0000 

20.1734 88.0062 1.0000 



9 This content is available online at <http://cnx.Org/content/m21492/l.6/>. 
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33 


7097~~ 


~~-8.4048~~' 


"~~64 


6574~~' 


"""1.0000 


33 


7144~~ 


~~-8.7191~~' 


"~~52 


3806~~' 


"""1.0000 


43 


8531~~ 


~~-1.1483~~' 


"~~59 


7193""' 


"""1.0000 


3b 


1086~~ 


~~2.3667 


"~~55 


7927""' 


"""1.0000 


34 


2309~~ 


~~8.2181 


"~~52 


1260""' 


"""1.0000 


30 


7876~~ 


~~11.8182~~' 


"~~46 


9810""' 


"""1.0000 


61 


8581~~ 


~~31.5183~~' 


"~~80 


7615""' 


"""1.0000 



To make use of this data, we need a function to display it. Enter and 
save the following generalization of the function from Demo 1 in "Vector 
Graphics: Two Dimensional Image Representation" (p. 169). Call it 
vhgraph . m. 

function~vhgraph~ (P,L, A,ps,ls) ; 
7.~vhgraph(P,L, A,PS,LS) "graphs" images~whose~points~are 
7.~stored~in~P~and~whose~lines~are~stored~in~L . ~The~points 
°/o~in~P~must~be~in~homogeneous~coordinates~in~either~2~or~3 
"/."dimensions , ~with~each~column~of ~P~representing~a~point . 
y,~The~lines~are~coded~in~L, ~with~each~column~of ~L~containing 
7,~2~ integer s~pointing~to~a~pair "of "point s~in~P~to~be 
7,~connected~by~a~line~segment . ~If ~A~is~present , ~the~points 
7.~in~P~are~transf ormed~to~A*P~bef orre "graphing. ~For~3D~data 
7,~points , ~only~the~f irst~two~coordinates~are~graphed, ~so~A 
7,~should~include~the~desired~projection~f rom~3D~to~2D. "The 
7,~point ~symbol~may~be~ specif ied~in~PS~and~the~line~type~ in 
7.~LS , ~if "desired 
7. 

7.~Richard~T . "Behrens , "October" 1989 . 
% 

7.~The~f irst~dection~of ~the~program~determines~the~sizes~of 
7.~all~the~input~matrices~and~chacks~that "they "make" sense . 
[mp,np] ~=~size(P) ; 
if ~ (nargin~ > ~ 1 ) 

[ml.nl] ~=~size(L) ; 
else 

ml~=~2;~nl~=~0; 
end 
if ~ (nargin~<=2) 

A~=~eye(mp) ; 
end 

[mA,nA]~=~size(A) ; 
if" ( (mp~=~nA) ~ I ~ (ml~=2) ) 

error (' Incompatible~sizes~of~ input "matrices . ") 
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end 

if ~(nargin~<=~3) ; 

ps~=~'*'; 
end 

P~=~A*P ; °/.~Perf orms~the~transf ormation~A~on~the~points 

o^~ ( e ff ec -t~is~only~local~to~this~f unction) . 

y,~The~next~section~contains~a~loop~that~renormalizes~the 
y~homogeneous~coordinates~of ~the~points~ if "necessary . 
renorm~=~f ind((P(mA, : )~=~1)) ; 
if ~isempty (renorm) 

f or~i~=~l : length (renorm) 

P(: , renorm (i) ) ~=~P( : , renorm (i))/P(mA, renorm (i) ) ; 

end 
end 

y,~The~next~program~line~sets~a~f ixed~scale~output "window 

7,~f rom~-50~to~50~in~both~x~and~y "direct ions~on~the~ screen. 

y,~For~aut omatic" seal ing~to~include~all~points~of "the 

"/."image, ~we~could~use~instead~the~line~q~=~min(min(P) ) ; 

y~r~=~max(max(P) ) ; 

q~=~-50;~r~=~50; 

axis ( [q~r~q~r] ) 

axis(' square' ) 

plot (P(l , :) ,P(2, :) ,ps) ~~y~Plots~trie~points~with~symbol~ps. 

hold~on y~Saves~the~points~wh.ile~we~plot 

f or~i~=~l :nl y~lines~with~line~type~LS . 

plot([P(l,L(l,i))P(l,L(2,i))],.. 

[P(2,L(l,i))P(2,L(2,i))],ls) 

end 
hold~off 

Enter the point matrix given at rhe beginning of this section (and take 
its transpose to put it in the usual form). Also enter the line matrix from 
Demo 1 in "Vector Graphics: Two Dimensional Image Representation" 
(p. 169). Save these two matrices and try looking at the image 

3> save dip3d 
> vhgraph(G,H) 

No dippers in sight, right? Without specifying a transformation matrix 
A, we have defaulted to looking down on the x — y plane from z = oo 
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(a parallel projection). This is how the constellations would look from a 
distant galaxy (say, a billion light years north of here) through an enor- 
mous telescope. We need a perspective view from the origin (Earth), but 
first we need a set of functions to give us the fundamental operators with 
which we can build the desired projection. 

Take R y (0) as an example. The function to build it looks like 

f unction~Ry~=~vhry~ (theta) ~ ; 
y,~Rotation~matrix~about~y-axis~f or~3-D~homogeneous 
"/."coordinates . 

Ry ~=~eye(4); 

Ry(l, 1)~=~ cos (theta) ; 

Ry (3,3) ~=~ cos (theta) ; 

Ry(3,l)~=~-sin(theta) ; 

Ry(l,3)~=~sin(theta) ; 

Enter and save hry.m as given. Then write functions for 

R x (9) vhrx. m 

R z (9) vhrz. m 
S (s x ,s y ,s z ) vhs. m (5.65) 

T(t x ,t y ,t z ) vht. m 

M (d) vhm. m 

Useful MATLAB functions for this task include zeros, eye, and diag. 

Now build and use a perspective projection with viewpoint Earth and 
projection plane at z = 1000 behind the dippers: 

1. translate Earth to z = —1000 so that the projection plane coincides 
with the x - y plane: T (O, 0, -1000); 

2. use the fundamental perspective projection: M ( — 1000); and 

3. translate back: T(0, 0,1000). 

> A = vht(0, 0,1000) * vhm(-lOOO) * vht (0,0, -1000) 

> vhgraph(G,H,A) 

Oops! Now the image is too big; it's mostly off the screen. Scale it down 
and have another look: 

> A = vhs (.06, .06, .06) * A 

> vhgraph(G,H,A) 

Now the view should look familiar. Leave A as it is now: 
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3> save dip3d 

Experiment with scale and rotation about the z-axis. For example, try 

> vhgraph(G,H,vhrz(pi/2) * A) 

The two-dimensional star positions given in Demo 1 in "Vector Graphics: 
Two Dimensional Image Representation" (p. 169) were obtained from the 
three-dimensional positions with the composite operator A you are now 
using. To compare the two, type 

> Gnew = A * G 

> for i = 1:14 

Gnew(;,i) = Gnew( : ,i)/Gnew(4,i) ; 
end 

> Gnew 

and compare the x and y coordinates with those of Demo 1 in "Vector 
Graphics: Two Dimensional Image Representation" (p. 169). 

Astronomers give star positions in equatorial coordinates using right 
ascension, declination, and distance. The following function converts 
equatorial coordinates, which are spherical, to Cartesian coordinates with 
the z-axis pointing north, the x-axis pointing at the vernal (Spring) 
equinox in the constellation Pisces, and the y-axis pointing toward the 
Winter solstice in the constellation Opheuchus. 

iunct ion~v~=~starxyz (rah, ram, deed, deem, dist) 
°/.~starxyz~is~the~cartesian~coordinates~of ~a~star~whose 
°/.~spherical~coordinates~(~e .g. ~f rom~a~star~catalog) "are 

y. 

7, rah right ~ascension~hours 

7, ram right ~ascension~minutes 

°/» deed declination~degrees 

°/» deem declination~minutes~ (should~be~negative 

°/» if ~decd~is~negative) 

°/» dist distance" (light "years) 

y. 

phi~=~ (pi/180) ~*~ (decd~+~decm/60) ; 
theta~=~ (pi/12) ~*~ (rah~+~ram/60) ; 
r~=~dist ; 

v~=~ [r~*~cos(phi) ~*~cos(theta) ; ~-r~*~cos(phi) ~*~sin(theta) ; 
r~*~sin(phi)] ; 
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Have you ever wondered what the constellations would look like from other 
places in the galaxy? We will soon see the answer. First we will view the 
dippers from Alpha Centauri, the nearest star, whose coordinates are 

-1.5680 1.3157 -3.6675. 

We will look toward the centroid of the fourteen stars in the dippers, 
located at 

-26.3632 12.8709 100.4714. 

To get the desired view, we must 

1. translate the viewpoint to the origin; 

2. rotate the centroid (direction to look) to the z-axis-note that the 
centroid will have new coordinates after step (1); and 

3. apply the composite A=S(.06, .06, .06)*T(0,0, 1000) *M(-1000) *T(0, 0,-1000 
(as used to view from Earth). 

Write a function vhz.m based on Exercise 5 from "Vector Graphics: 
Three-Dimensional Homogeneous Coordinates" (Exercise 5.11) to accom- 
plish step (2). Test it on several random points to make sure it works right. 
Now write a general perspective projection function called vhview.m. The 
function vhview should accept as inputs two vectors, the first specifying 
the viewpoint and the second the point to look toward. Its output should 
be a composite operator that performs all three of the preceding steps. 

Now we want to look toward the centroid of the dippers from Alpha 
Centauri. To do so, enter the vectors for the two points of interest and 
construct the view like this: 

> acentauri = [-1.5680; 1.3157; -3.6675] 

> centroid = [-26.3632; 12.8709; 100.4714] 
3> A = vhview (acentauri, centroid) 

> vhgraph(G,H,A) 

3> title('From Alpha Centauri') 

The farther we move from Earth, the more distorted the dippers will 
look in general. It should be easy now to view them from any desired 
location. Just choose a viewpoint, recalculate the composite operator for 
that viewpoint using vhview, and use vhgraph. Follow this procedure to 
view the dippers from each of the stars in the following list. You will need 
to use starxyz first to convert their coordinates. 
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Star 


Right Ascen- 
sion 


Declination 


Distance (ly) 


Alpha Centauri 


14h 40m 


-60° 50' 


4.2 


Sirius 


6h 45m 


-16°43' 


9.5 


Arcturus 


14h 16m 


19°11' 


16.6 


Pollux 


7h 45m 


28°02' 


35.9 


Betelgeuse 


5h 55m 


7°24' 


313.5 



Table 5.1: Table 1 is a six- row and four-column table with the first row 

as a header, the first column describing different stars, and the values in 

the second through fourth columns describing the corresponding right 

ascension, declination, and distance for each star. 



Of course, star viewing is not the only application of vector graphics. 
Do some experiments with the unit cube (see Exercise 2 from "Vector 
Graphics: Three-Dimensional Homogeneous Coordinates" (Exercise 5.8)). 
View the cube from location (4,3,2) looking toward the origin using the 
procedure just outlined for stars. You may need to adjust the scaling to 
get a meaningful view. 
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Chapter 6 

Filtering 



6.1 Filtering: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



6.1.1 Notes to Teachers and Students: 

Filtering is one of the most important things that electrical and com- 
puter engineers do. In this chapter we extend everyday understanding of 
filters to numerical filters. We then study weighted moving averages and 
exponential averages. We define the important test signals for electrical 
and computer engineering and show how filters respond to them. The 
idea that filters are characterized by their response to simple test signals 
is fundamental. In the numerical experiment (Section 6.7), students ex- 
plore the frequency response of a simple filter, a concept that forms the 
basis of circuit theory, electronics, optics and lasers, solid-state devices, 
communications, and control. 

6.1.2 Introduction 

A filter is any device that passes material, light, sound, current, velocity, 
or information according to some rule of selectivity. Material (or mechan- 



1 This content is available online at <http://cnx.Org/content/m21417/l.6/>. 
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ical) filters are commonplace in your everyday life: 

i. coffee filters pass flavored water while filtering out coffee grounds; 
ii. Goretex fibers pass small, warm perspiration droplets while filtering 

out large, cool droplets of rain or snow; 
iii. fiberglass strands in a furnace filter pass warm air while filtering out 

particles of dirt and dust; 
iv. a centrifuge retains material of low density while spinning out (or 

filtering out) material of high density; and 
v. an electrostatic precipitator filters out dust and other effluents by 

attaching charge to them and using an electric field to move the 

charged particles to a high potential drain. 

The first three of these examples selectively pass material according to 
size; the last two selectively pass material according to its mass density. 
Typical filters for light are 

i. UV filters on camera lenses and eyeglasses that pass light in the 
range of visible wavelengths while blocking light in the invisible 
(but damaging) ultraviolet range; 

ii. polaroid lenses that pass light that is randomly polarized while 
blocking out glare that is linearly polarized; 

iii. green fabrics that reflect green light and absorb other colors; 

iv. red taillights that pass light in the long wavelength red range and 
reflect light in the short wavelength violet range (look at the inside 
of your taillights to see violet); and 

v. glacial ice that absorbs all but the blue wavelengths so that it ap- 
pears blue. 

Exercise 6.1 

List as many examples of natural and man-made sound filters 
as you can. 

Satellite Television. Among current filters, the tuner in a super- 
heterodyne receiver is, perhaps, the first example that comes to mind. 
But satellite TV filters are another fascinating example. A typical C-band 
satellite has twelve transponders (or repeaters), each of which transmits 
microwave radiation in a personalized 36 MHz band. (The abbreviation 
MHz stands for megahertz, or 10 6 Hz, or 10 6 cycles per second. Other 
common abbreviations are Hz for 1 Hz, kHz for 10 3 Hz, and GHz for 10 9 
Hz.) Each transponder actually transmits two channels of information, 
one vertically polarized and one horizontally polarized. There is an 8 MHz 
guard band between each band, and the vertical and horizontal channels 
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are offset by 20 MHz. The transmission scheme for the 24 channels is il- 
lustrated in Figure 1 (Figure 6.1). The entire transmission band extends 
over 540 MHz, from 3.7 x 10 9 Hz to 4.24 x 10 9 Hz. The satellite receiver 
has two different microwave detectors, one for vertical and one for hor- 
izontal polarization, and a microwave tuner to tune into the microwave 
band of interest. 

Exercise 6.2 

Check that the transmission scheme of Figure 1 (Figure 6.1) 
consumes 540 MHz of bandwidth. 

Exercise 6.3 

List as many examples of natural and man-made devices for 
velocity filtering as you can. 



8 MHz 
36 MHz | | 



V, V 2 V z xv Vs. 
H ■ 1 I 1 — I - 1— i V 

3.7 x 10 9 

8 MHz 
20 MHZ 36 MHz I- 



\v 




Figure 6.1: Satellite TV- V;, Vertically Polarized Channel i;H 3 , 
Horizontally Polarized Channel j 



An Aside on Hertz and Seconds. The abbreviation Hz stands 
for hertz, or cycles/second. It is used to describe the frequency of a 
sinusoidal signal. For example, house current is 60 Hz, meaning that it 
has 60 cycles each second. The inverse of Hz is seconds or, more precisely, 
seconds/cycle, the period of 1 cycle. For example, the period of 1 cycle for 
house current is 1/60 second. When we are dealing with sound, electricity, 
and electromagnetic radiation, we need a concise language for dealing with 
signals and waves whose frequencies range from Hz (called DC or direct 
current) to 10 18 Hz (visible light). Table 1 summarizes the terms and 
symbols used to describe the frequency and period of signals that range 
in frequency from Hz to 10 12 Hz. 
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Terms and symbols for Sinusoidal Signals 
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Frequency 



Hz 



Term 



Units 



Period 
Seconds Term 



Units 



Exampls 



Hz 



hertz 



1 Hz 



second 



1 sec 



battery 
cur- 
rent: 
Hz 

house 
cur- 
rent: 
60 Hz 



kHz 



kilohertz 



10 3 Hz 



msec 



millisecondLO" 3 sec 



midfrequ 
sound 



ency 



MHz 



megahertz 10 6 Hz 



^sec 



microsecorM) sec 



clock 
fre- 
quen- 
cies in 
micro- 
com- 
puters 



GHz 



gigahertz 10 9 Hz 



nsor: 



nanoseco ndO" 9 sec 



microwa"\ 
radia- 
tion for 
satel- 
lite 
com- 
muni- 
cation 



continued on next page 
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THz 


terahertz 


10 12 Hz 


psec 


picosecor 


dlO" 12 
sec 


infrared 
radia- 
tion 



Table 6.1 



Numerical Filters. Rather amazingly, these ideas extend to the do- 
main of numerical filters, the topic of this chapter. Numerical filters are 
just schemes for weighting and summing strings of numbers. Stock prices 
are typically averaged with numerical filters. The curves in Figure 2 (Fig- 
ure 6.2) illustrate the daily closing average for Kellogg's common stock 
and two moving averages. The 50-day moving average is obtained by 
passing the daily closing average through a numerical filter that averages 
the most current 50 days' worth of closing averages. The 200-day moving 
average for the stock price is obtained by passing the daily closing prices 
through a numerical filter that averages the most current 200 days' worth 
of daily closing averages. The daily closing averages show fine-grained 
variation but tend to conceal trends. The 50-day and 200-day averages 
show less fine-grained variation but give a clearer picture of trends. In 
fact, this is one of the key ideas in numerical filtering: by selecting our 
method of averaging, we can filter out fine-grained variations and pass 
long-term trends (or vice versa), or we can filter out periodic variations 
and pass nonperiodic variations (or vice versa). Figure 2 (Figure 6.2) illus- 
trates that moving averages typically lag increasing sequences of numbers 
and lead decreasing sequences. Can you explain why? 

We will call any algorithm or procedure for transforming one set of 
numbers into another set of numbers a numerical filter or digital Bi- 
ter. Digital filters, consisting of memories and arithmetic logic units 
(ALUs), are implemented in VLSI circuits and used for communication, 
control, and instrumentation. They are also implemented in random-or 
semicustom-logic circuits and in programmable microcomputer systems. 
The inputs to a digital filter are typically electronic measurements that 
are produced by A/D (analog-to-digital) conversion of the output of an 
electrical or mechanical sensor. The outputs of the filter are "processed," 
"filtered," or "smoothed" versions of the measurements. In your more 
advanced courses in electrical and computer engineering you will study 
signal processing and system theory, assembly language programming, mi- 
croprocessor system development, and computer design. In these courses 
you will study the design and programming of hardware that may be used 
for digital filtering. 
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Figure 6.2: Dow-Jones Averages (Adapted from the New York 
Stock Exchange, Daily Graphs, William O'Neil and Co., Inc., Los 
Angeles, California) 



6.2 Filtering: Simple Averages 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The simplest numerical filter is the simple averaging filter. This filter is 
defined by the equation 



1 N 
N ^ 



(6.1) 



2 This content is available online at <http://cnx.org/content/m21421/!. 6/>. 
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The filter output x is the average of the JV filter inputs ui,u 2 , ••• , ujv. 
These inputs may be real or complex numbers, and x may be real or com- 
plex. This simple averaging filter is illustrated in Figure 1 (Figure 6.3). 




Figure 6.3: A Simple Averaging Filter 



Example 6.1 

If the averaging filter is excited by the constant sequence u\ = 
u<i = ■ ■ ■ = wjv = u, then the output is 

1 N 
x=— ^u = u. (6.2) 

71=1 

The output is, truly, the average of the inputs. Now suppose 
the filter is excited by the linearly increasing sequence 



u n = n, n=l,2,...,N. (6-3) 

This sequence is plotted in Figure 2 (Figure 6.4). How do we 
sum such a sequence in order to produce the average xl For N 
even, the average may be written as 



— (xi + x N ) + — (x 2 + x N ^) + ■ ■ ■ + — (x N/2 



HN/2) + l) 



(6.4) 



iY 



Each pair-sum in parentheses equals N + 1, and there are 2 
such pair-sums, so the average is 



1 N 



(N + l) 



N+l 



N 2 v " ' ' 2 

This is certainly a reasonable answer for the average of a linearly 
increasing sequence. See Figure 2 (Figure 6.4). 



(6.5) 
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N+ 



u n versus n 



2 -- 
1 -- * 



H 1 1 1 1 1 \r 

12 3 4 5 6 7 



n 



CJV) 



Figure 6.4: Linearly Increasing Sequence 



Exercise 6.4 

Write a; = -^ 2~^ n =i n as a sum °f pair-sums for N odd. What 
does x equal? 

General Sum Formula. Suppose the input to the simple averaging 
filter is the polynomial sequence 



u n = n , n= 1,2, ...,7V 



(6.6) 



where A; is a non-negative integer such as k = 0,1,2,.... The output of 
the filter is 



(k) 



i N 

N ^ 



(6.7) 



71=1 
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(k) 

We rewrite x as x N to remind ourselves that we are averaging TV num- 
bers, each of which is n k . For example, when N = 8 and k = 2, 

1 8 1 

4 2) = -Vn 2 = -(1 + 4 + 9+ ••• + 64). (6.8) 

8 — ' 8 

n— 1 

Rather than study the average x N , we will study the sum Nx N and 
divide by TV at the very end: 

AT 

S^JVa^^V. (6.9) 

(k) 

The sum 5^ may be rewritten as the sum 



SP = J2n k + N k 



l (6.10) 

= S^_ 1 + N k . 

(k) 

This result is very important because it tells us that the sum S N , viewed 

(k) 

as a function of TV, obeys a recursion in which S N is just the sum using 
one less input, namely, S N _ X , plus TV fe . Now, since polynomials are the 

(k) 

most general functions that obey such recursions, we know that s N must 
be a polynomial of order k + 1 in the variable TV: 

8 P = a + aiTV + a 2 TV 2 + • • • + a k+1 N k+1 . (6.11) 

Let's check to see that this polynomial really can obey the required 

(k) 

recursion. First note that S N _ 1 is the following polynomial: 

sfili = a + oi (TV - 1) + • • • + a fc+1 (TV - l) fe+1 . (6.12) 

The term (TV - l) fc+1 produces (£ +1 ) TV fe+1 (-l)° + (^ +1 ) TV^-l) 1 + • • •. 
(Remember the binomial expansion?) Therefore the difference between 
S^ and S^l j is 

S { n } - sP_j_ = c + Cl TV + • • • + c fe TV fc . (6.13) 

This recursion is general enough to produce the difference TV^ provided 
we can solve for ao,ai, ... , cik+i to make Co = c\ = ■ ■ ■ = Ck-i = and 

(k) 

Cfe = 1. We know that S N = for TV = 0, so we know that oo = 0, 

(k) 

meaning that the polynomial for S N can really be written as 

S { p = aiTV + a 2 TV 2 + • • • + a fe+ iTV fe+1 . (6.14) 
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In order to solve for the coefficients of this polynomial, we propose to 

(k) 
write out our equation for s N as follows: 



(N = l) 
(N = 2) 
(TV = 3) 



S\ 



(fc) 



„(fc) 



a i 



2ai 

3ai 



+ flfe+i 

- 2 fc+1 a fe+1 

- 3 fc+1 a fe+1 



(6.15) 



(fc) 



fc fc+i 



(7V = fc) S*^ = fcai 

(7V = fc + l) S^ = (fc + l)oi + ■•■ + (* - 

Using the linear algebra (Section 4.1) we learned earlier, we may write 
these equations as the matrix equation 



«fc+i 

1) a k +i- 



1 

4 

fc 2 



1 

2 fc+i 



(fc + i) (k + iy 



k k+i 
(fc + i) 



fc+i 



o 2 



Ofe+l 



(fc) 
3 1 
(fc) 



6' 



c(fc) 

D fc+1 



(6.16) 



The terms on the right-hand side of the equal sign are "initial conditions" 

(k) 

that tell us how the sum S N begins for N = 1, 2, ..., k + 1. These initial 



(fc) 



l k 



conditions must be computed directly. (For example, S. 
Then the linear system of (k + 1) equations in (fc + 1) unknowns may be 
solved for 01,02, ...,a,k+i- The solution for 5^ is then complete, and we 
may use it to solve for S^ for arbitrary N. 

Example 6.2 

When fc = 2, we have the following equation for the coefficients 
oi, 6t2, and as in the polynomial SJy = a±N + C12N 2 + a^N 3 : 



1 1 1 

2 4 8 

3 9 27 





Ol 






I 2 




a-2 


= 




l 2 + 2 2 




. fl 3 . 




. l2 


+2 2 + 3 2 



1 

5 

14 



(6.17) 



Exercise 6.5 

Solve for 01,02,03 in the linear equation of Example 2 (Ex- 

aiN + a 2 N 2 + a 3 N 3 obeys the 



(2) 

ample 6.2). Show that S N 



recursion S 



S 



(2) 
N-l 



N 2 . 
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Exercise 6.6 

(MATLAB) Write a MATLAB program to determine the coef- 

(k) 

ficients oi, 02, •••, a&+i for the polynomial S N . Generate a table 

(k) 

of formulas for the averages x N for k = 1,2,. ..,5. Evaluate 
these formulas for N = 2, 4, 8, and 16. 

Exponential Sums. When the input to an averaging filter is the se- 
quence 



0,1,2, 



,N-1, 



(6.18) 



we say that the input is exponential (or geometric). Typical sequences 
are illustrated in Figure 6.5 for a = 0.9, a = 1, and a = 1.1. Don't let it 
throw you that we have changed the index to run from to TV — 1 rather 
than from 1 to N. This change is not fundamentally important, but it 
simplifies our study. The sum of the inputs is 



N-l 



Sn = 2J a ™- 



(6.19) 



n=0 



a n versus n 



H 1 1 h 

2 3 4 



( a = i.n 



( a= \) 



( a= 0.9) 

; t • . 
h — 1 n 



Figure 6.5: Exponential Sequences 
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How do we evaluate this sum? Well, we note that the sum ciSn is 

JV-l 



aS N = Ea n+1 = Ek=i ak 

n=0 
v-JV-1 , N i (6.20) 

S N + a N -l. 
Therefore, provided a / 1, the sum Sn is 

1 -a N 

S N = - , o^l. (6.21) 

1 — a 

This formula, discovered already in the chapter covering the functions e x 
and e je (Section 2.1), works for a/ 1. When a = 1, then Sn = N: 



l-a' 



a/ 1 



S N = { 1 - a ' (6.22) 

N, a = 1. 

When |a| < 1, then a N — > for AT — > oo, and we have the asymptotic 
formula 

/im SW = , \a\ < 1. (6.23) 

N^oo 1 — a 

Exercise 6.7 

Evaluate SV = J2 n =o a " an( ^ -^ w = n^n ^ or a = 0.9, 1, and 
1.1 and for N = 1,2,4,8,16, and 32. 

Exercise 6.8 

Prove that Sn = J2 n =o a " obeys the recursion 

S N = S N - 1 + a N ~ 1 . (6.24) 

Prove that Sn = N obeys this recursion for a = 1 and that 

i — N 
Sn = \* obeys it for a/1. 

Recursive Computation. Every sum of the form 

N-l 

S N = ^u n (6.25) 

n=0 

obeys the recursion 

Sn = SW-i + ujv-i- (6.26) 
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This means that when summing numbers you may "use them and discard 
them." That is, you do not need to read them, store them, and sum them. 
You may read u to form S\ and discard u ; add u\ to S\ and discard 
u\ ; add ui to Si ; and continue. 




&•&*■ 



U r 




memory 



s n 



Figure 6.6: The Recursion S„+i = S n + u n 



This is very important for hardware and software implementations of 
running sums. You need only store the current sum, not the measurements 
that produced it. Two illustrations of the recursion S n+ \ = S n + u n 
are provided in Figure 4 (Figure 6.6). The diagram on the left is self- 
explanatory. The diagram on the right says that the sum S n is stored 
in a memory location, to be added to u n to produce S n +i, which is then 
stored back in the memory location to be added to m„+i, and so on. 



6.3 Filtering: Weighted Averages 3 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



3 This content is available online at <http://cnx.Org/content/m21423/l.5/>. 
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Weighted, tapered, or windowed averages are straightforward generaliza- 
tions of simple averages. They take the form 



JV 

x = 



y^ w n u n (6.27) 



with the constraint that the "weights in the window," w n , sum to 1: 

N 

Y J w n = l. (6.28) 

When w n = jf then x is the simple average studied in the section on 
"Simple Averages" (Section 6.2). 

Example 6.3 

There are many windows that are commonly used in engineering 
practice. For TV odd, the standard triangular window is 

2 ( 2 ,JV+1 A 

i-Trr-rl^--"! • ( 6 - 29 ) 



N+l \ N+l' 2 

This window, illustrated in Figure 1 (Figure 6.7), weights the 

input U(at+i)/2 by -^y and the inputs u\ and un by I jA^ ) 
The most general triangular window takes the form 

w„ = a ( 1 - /3\ — ^ n\);a,P>0, N odd. (6.30) 
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w„ 



•i 1 i i h 

12 3 4 5 



2 

N* 1 



' (-Z-) 2 



7 3 9 10 1! 



n 



Figure 6.7: Triangular Window 



Exercise 6.9 

Determine the constraints on a and (3 to make the general tri- 
angular window a valid window (i.e., 5^ n =i w « = ■'■)■ Show that 
(3 is a valid solution. Propose another solution that 



2 
JV+1 



a 

you like. 

Exercise 6.10 

You are taking three 3-credit courses, one 5-credit course, and 
one 2-credit course. Write down the weighted average for com- 
puting your GPA in a system that awards 4.0 points for an A, 3.0 
points for a B, ..., and (horrors!) points for an F. 



6.4 Filtering: Moving Averages 4 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



This content is available online at <http://cnx.Org/content/m21418/l.5/>. 
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Moving averages are generalizations of weighted averages. They are de- 
signed to "run along an input sequence, computing weighted averages as 
they go." A typical moving average over JV inputs takes the form 



w u r , 



/Lfc=0 W k u n-k 
WWn-1 H h WAr-lU„_(AT_i). 



(6.31) 



The most current input, u n , is weighted by wq\ the next most current 
input, u n -\, is weighted by w\ ; and so on. This weighting is illustrated 
in Figure 1 (Figure 6.8). The sequence of weights, wo through iujv-i, is 
called a "window," a "weighting sequence," or a "filter." In the example 
illustrated in Figure 6.8, the current value u n is weighted more heavily 
than the least current value. This is typical (but not essential) because 
we usually want x n to reflect more of the recent past than the distant 
past. 




Figure 6.8: Moving Average 



Example 6.4 

When the weights wq,w\, ...,wn-i "±c cm c^uai uu -^, 
moving average x n is a "simple moving average": 



are all equal to -h, then the 



1 

N 



H I-uat-iJ 



(6.32) 



This is the same as the simple average (Section 6.2), but now 
the simple average moves along the sequence of inputs, averaging 
the N most current values. 
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Exercise 6.11 

Evaluate the moving average x n = X^fe=o ~M u n-k for the inputs 

0, n<0 

(a) u n = { 

u, n > 0; 

(b) u n = { 

n, n > 0. 

Interpret your findings. 

Exercise 6.12 

Evaluate the simple moving average x n = ~^2 k=0 j^u n -k when 
u n is the sequence 

. 0, n < , 

«n = { (6.33) 

a n , n > 0. 

Interpret your result. 

Example 6.5 

When the weights w n equal woa n for n = 0, 1, ..., N — 1, then 
the moving average x n takes the form 
a; n = w 2^ fe=0 a K M„-fe. 

When a < 1, then u n is weighted more heavily than 
u n-(N-i): when a > 1, u„_(jv-i) ls weighted more heavily than 
u n ; when a = l,u n is weighted the same as m„_(jv-i)- 
Exercise 6.13 

Evaluate wo so that the exponential weighting sequence 
Wn =woa n (n = 0, 1, ..., N — 1) is a valid window (i.e., 
E„=o w n = 1). 
Exercise 6.14 

Compute the moving average x n = 5^fc=o w o aku n-k when the 
input sequence u n is 

r b n , n > , 

u n = { ~ (6.34) 

0, n < 0. 
What happens when b = a! Can you explain this? 
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6.5 Filtering: Exponential Averages and Re- 
cursive Filters 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Suppose we try to extend our method for computing finite moving aver- 
ages to infinite moving averages of the form 

Eoo 
k=0 w k u n-k . . 

= W U n + WxUn-i H h WlOOOMn-1000 H 

In general, this moving average would require infinite memory for the 
weighting coefficients wo, toi, ■•■ and for the inputs u n ,u n -i, .... Further- 
more, the hardware for multiplying WkU n -k would have to be infinitely 
fast to compute the infinite moving average in finite time. All of this is 
clearly fanciful and implausible (not to mention impossible). But what if 
the weights take the exponential form 

r 0, fc<0 , 

w k = { , (6.36) 

w a k , k > 0? 

Does any simplification result? There is hope because the weighting 
sequence obeys the recursion 

0, k < 

w k = { w , k = (6.37) 

awk^i k > 1. 
This recursion may be rewritten as follows, for k > 1: 

Wk — awk-i = 0, k > 1. (6.38) 



5 This content is available online at <http://cnx.Org/content/m21416/l.5/>. 
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Let's now manipulate the infinite moving average and use the recursion 
for the weights to see what happens. You must follow every step: 



Eoo 
k=Vl w k u n _ k 

SfeLl w kU n -k + w u n 

Sfcll aw k-\U n -k + w u n 

a J2m=0 w mUn-l-m + W U n 

as«-i + w u n . 



(6.39) 



This result is fundamentally important because it says that the output of 
the infinite exponential moving average may be computed by scaling the 
previous output x n -i by the constant a, scaling the new input u n by wo, 
and adding. Only three memory locations must be allocated: one for wo, 
one for a, and one for x n -i. Only two multiplies must be implemented: 
one for ax„_i and one for wou n . A diagram of the recursion is given in 
Figure 1 (Figure 6.9). In this recursion, the old value of the exponential 
moving average, x„_i, is scaled by a and added to t«Qii n to produce the 
new exponential moving average x n . This new value is stored in memory, 
where it becomes x n -\ in the next step of the recursion, and so on. 



u. 



io, 



*Xj<n 



A 



memory 



a 



.•^n 



Figure 6.9: Recursive Implementation of an Exponential Moving 
Average 



Exercise 6.15 

Try to extend the recursion of the previous paragraphs to the 
weighted average 



N-l 

y^ q k u n - k 

fe=0 



(6.40) 
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What goes wrong? 

Exercise 6.16 

Compute the output of the exponential moving average 
x n =ax n _i + it>ou n when the input is 

0, n < , 

u n = { (6.41) 

u, n > 0. 

Plot your result versus n. 

Exercise 6.17 

Compute wo in the exponential weighting sequence 

, 0, n < , 

w n = { (6.42) 

a n WQ, n > 

to make the weighting sequence a valid window. (This is a 
special case of Exercise 3 from Filtering: Moving Averages (Ex- 
ercise 6.13).) Assume — 1 < a < 1 



6.6 Filtering: Test Sequences 6 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

When we design a filter, we design it for a purpose. For example, a mov- 
ing average filter is often designed to pass relatively constant data while 
averaging out relatively variable data. In an effort to clarify the behavior 
of a filter, we typically analyze its response to a standard set of test sig- 
nals. We will call the impulse, the step, and the complex exponential the 
standard test signals. 

Unit Pulse Sequence. The unit pulse sequence is the sequence 



/ 1; 


n = 


n — On — \ 




o, 


n^ 0. 



(6.43) 



6 This content is available online at <http://cnx.Org/content/m21422/l.5/>. 
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This sequence, illustrated in Figure 1 (Figure 6.10), consists of all zeros 
except for a single one at n = 0. If the unit pulse sequence is passed 
through a moving average filter (whether finite or not), then the output 
is called the unit pulse response: 



X) WkSn-k 
k=0 

W n . 



(6.44) 



♦ ♦♦!♦♦ 



12 3 



n 



Figure 6.10: Unit Pulse Sequence 



(Note that 6 n -k = unless n = k.) So the unit pulse sequence may 
be used to read out the weights of a moving average filter. It is common 
practice to use Wk (the k th weight) and hk (the k th impulse response) 
interchangeably. 

Exercise 6.18 

Find the unit pulse response for the finite moving average x n = 
~l2k=o w kU n -k- Caution: You must consider n < 0,0 < n < 

N - 1, and n > N. 

Exercise 6.19 

Find the unit pulse response for the recursive filter x n = ax n -i + 
w u n . 
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Unit Step Sequence. The unit step sequence is the sequence 

1, n > 



^n — sti — i 



0, n < 0. 



(6.45) 



This sequence is illustrated in Figure 2 (Figure 6.11). When this sequence 
is applied to a moving average filter, the result is the unit step response 



fjn 



En 
k=0 w k 

Y!k=O h k- 



(6.46) 



The unit step response is just the sequence of partial sums of the unit 
pulse response. 



+++ 



f vsn 



• • • 



MM 



n 







Figure 6.11: Unit Step Sequence 



Exercise 6.20 

Find the unit step response for the finite moving average fil- 
ter x n = 5^fc=o w kUn-k- Specialize your general result to the 
special case where u>k = jj for k = 0,1, ...,N — 1. 

Exercise 6.21 

Find the unit step response for the recursive filter x n = ax n ^i + 
w u n . 
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Complex Exponential Sequence. The complex exponential sequence 
is the sequence 



Uk 



Jk6 



fc = 0,±l,±2,. 



(6.47) 



This sequence, illustrated in Figure 3 (Figure 6.12), is a "discrete-time 
phasor" that "ratchets" counterclockwise (CCW) as k moves to k + 1 and 
clockwise (CW) as k moves to k — 1. Each time the phasor ratchets, it 
turns out an angle of 9. Why should such a sequence be a useful test 
sequence? There are two reasons. 




e -j29 



Figure 6.12: Discrete-Time Phasor 



(i) 



Jke 



represents (or codes) coskO. The real part of the sequence 



e J is the cosinusoidal sequence coskO: 

Re [e jk0 ] = coskO. (6.48) 

Therefore the discrete-time phasor e^ ke represents (or codes) coskO in 

the same way that the continuous-time phasor e- 7 "* codes cosujt. If the 



moving average filter 



/ 4 hk u n-k 
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(6.49) 



fe=0 



has real coefHcients, we can get the response to a cosinusoidal sequence 
by taking the real part of the following sum: 



(6.50) 



E hkcos (n — k) 8 


k=0_ 




CO 


Re 


J2 hke^-W 




.fe=0 




oo 


le 


e jn9 E h k e-i ke 


_ 


k=0 



In this formula, the sum 



^2h k ( 

fe=0 



-ike 



(6.51) 



is called the complex frequency response of the filter and is given the 
symbol 



ff(e")=X>< 



-ike 



(6.52) 



fc=0 



This complex frequency response is just a complex number, with a mag- 
nitude \H (e^) | and a phase arg H (e^ e ). Therefore the output of the 



moving average filter is 



Re [e jn9 H (e^ 9 )} 

Re[e' n0 \H(e^)\e iar9H ( eJe )] 

\H (ei e ) | cos [nO + argH (e je )] 



(6.53) 



This remarkable result says that the output is also cosinusoidal, but its 
amplitude is \H (e J ) \ rather than 1, and its phase is argH (e^ 9 ) rather 
than 0. In the examples to follow, we will show that the complex "gain" 
H (e^ 9 ) can be highly selective in 6, meaning that cosines of some angular 
frequencies are passed with little attenuation while cosines of other fre- 
quencies are dramatically attenuated. By choosing the filter coefHcients, 
we can design the frequency selectivity we would like to have. 
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(ii) e jfce is a sampled data version of e Jwt . The discrete-time 
phasor e> ke can be produced physically by sampling the continuous-time 
phasor e- 7 ^* at the periodic sampling instants t^ = kT: 

e jk8 = eMi = e J^T 

1 (6.54) 

e = tuT. 

The dimensions of 9 are radians, the dimensions of w are radians/second, 
and the dimensions of T are seconds. We call T the sampling interval 
and ^ the sampling rate or sampling frequency. If the original angular 
frequency of the phasor e JW ' is increased to u + m (^f), then the discrete- 
time phasor remains e^ ke : 

e J[u,+m(2n/T)]tl T = & j (ukT +krn2ir) = £ jk0 _ (6.55) 

This means that all continuous-time phasors of the form e^ UJ+rn ( 27T / T ^ t 
"hide under the same alias" when viewed through the sampling operation. 
That is, the sampled-data phasor cannot distinguish the frequency to from 
the frequency oj + m^-. In your subsequent courses you will study aliasing 
in more detail and study the Nyquist rule for sampling: 

2tt 1 n , 

T < — ; - > — 6.56 

~ tt ' T ~ 2tt v ' 

This rule says that you must sample signals at a rate (^) that exceeds 
the bandwidth i=- of the signal. 

Example 6.6 

Let's pass the cosinusoidal sequence u/, = cos kO through the 
finite moving average filter 



■En — 2-uk—0 ^k^n—k 



h k = jj fc = 0,l, ..., N-l. 
We know from our previous result that the output is 



(6.57) 



x n = \H (e 10 ) \cos [n6 + argH (e J0 )] . (6.58) 

The complex frequency response for this example is 



N l-e-i e 



(6.59) 
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(Do you see your old friend, the finite sum formula, at work?) 
Let's try to manipulate the result into a more elegant form: 



H (eJ e ) 



N ' 



-J(N/2)er „i{N/2)B_ 



e -i(e/2)\ e j(e/2)_ e -j(o/2)\ 



N' 



-j[(N-l)/2]0>_ 






(6.60) 



The magnitude of the function H (e- 7 ^) is 



\H (e") | 



( 



N , 



N' 



sin 



m 



(6.61) 



At = 0, corresponding to a "DC phasor," H (e je ) equals 1; at 
9 = jf\H (e^ 6 ) = 0|. The magnitude of the complex frequency 
response is plotted in Figure 4 (Figure 6.13). 




2 <f) 



Figure 6.13: Frequency Selectivity of a Moving Average Filter 



This result shows that the moving average filter is frequency 
selective, passing low frequencies with gain near 1 and high fre- 
quencies with gain near 0. 

Exercise 6.22 

Compute the phase of the complex frequency response 



H(, 



j«\ 



1 

N' 



-j[(N-l)/2]6'_ 



( 



m 



(6.62) 



Exercise 6.23 

Choose the filter length N for the filter h/. 



-i- k 



0,1, ...,7V- 



1, so that a 60 Hz cosine, sampled at the rate ^ = 180, is 
perfectly zeroed out as it comes through the filter. 
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Exercise 6.24 

(MATLAB) Write a MATLAB program to compute and plot 
the magnitude \H (e- 7 ' 8 ) | and the phase arg H (e j8 ) versus — tt < 
9 < ir when 



H (e* e ) = J-e-W-V W" 1 ^ ) ( 6 . 63 ) 



1 c -j\(N-i)/2]e sm ( 
N sin (\6) 

Choose suitable increments for 9. 

Exercise 6.25 

Compute the complex frequency response H (e J ) for the recur- 
sive filter x n = ai n _i + wqu. 



L n- 



6.7 Filtering: Numerical Experiment (Fre- 
quency Response of First-Order Filter) 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Consider the exponential moving average filter 

oo 

x n = Y^ a k u n -k; a, = 0.98. (6.64) 

k=0 

1. Write out a few terms of the sum to show how the filter works. 

2. Write x n as a recursion and discuss the computer memory required 
to implement the filter. 

3. Compute the complex frequency response H (e-^) for the filter. 

4. Write a MATLAB program to plot the magnitude and phase of the 
complex frequency response H (e- 79 ) versus 9 for 9 = —nto + n 
in steps of || Do this for two values of a, namely, a = 0.98 and 
a = —0.98. Explain your findings. 

5. Write a MATLAB program to pass the following signals through 
the filter when a = 0.98: 

a. u n = o n 



7 This content is available online at <http://cnx.Org/content/m21419/l.4/>. 
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b. 


^n — sn 


c. 


Un = inCOS^Tl 


d. 


U n = inCOS^U 
U n = S,nCOS-^-n 


0. 


f. 


g- 


U n = inCOS^fn 


h. 


U n = inCOs\n. 



Plot the outputs for each case and interpret your findings in terms of 
the complex frequency response H (e 3 ). Repeat step 5 for a = —0.98. 
Interpret your findings. 
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Chapter 7 

Binary Codes 



7.1 Binary Codes: Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Acknowledgment: Richard Hamming's book, Information Theory 
andCoding, Prentice-Hall, New York (1985) and C. T. Mullis's unpub- 
lished notes have influenced our treatment of binary codes. The numerical 
experiment was developed by Mullis. 

We use this chapter to introduce students to the communication 
paradigm and to show how arbitrary symbols may be represented by 
binary codes. These symbols and their corresponding binary codes may 
be computer instructions, integer data, approximations to real data, and 
so on. 

We develop some ad hoc tree codes for representing information and 
then develop Huffman codes for optimizing the use of bits. Hamming 
codes add check bits to a binary word so that errors may be detected 
and corrected. The numerical experiment (Section 7.6) has the students 
design a Huffman code for coding Lincoln's Gettysburg Address. 



1 This content is available online at <http://cnx.Org/content/m21405/l.5/>. 
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CHAPTER 7. BINARY CODES 



7.1.1 Introduction 

It would be stretching our imagination to suggest that Sir Francis had 
digital audio on his minde (sic) when he wrote the prophetic words 

Sir Francis Bacon, 1623 

...a man may express and signifie the intentions of his minde, 
at any distance... by... objects... capable of a twofold differ- 
ence onely. 

Nonetheless, this basic idea forms the basis of everything we do in 
digital computing, digital communications, and digital audio/video. In 
1832, Samuel F. B. Morse used the very same idea to propose that tele- 
gram words be coded into binary addresses or binary codes that could 
be transmitted over telegraph lines and decoded at the receiving end to 
unravel the telegram. Morse abandoned his scheme, illustrated in Fig- 
ure 1 (Figure 7.1), as too complicated and, in 1838, proposed his fabled 
Morse code for coding letters (instead of words) into objects (dots, dashes, 
spaces) capable of a threefold difference onely (sic) . 



address 
generator 

(or 
codebook) 



address, f»j = 011010 



word 
generator 
(inverse 
codebook) 



(associative memory) 
(coder) 



(memory) 
(decoder) 



Figure 7.1: Generalized Coder-Decoder 



The basic idea of Figure 1 (Figure 7.1) is used today in cryptographic 
systems, where the "address a/ 1 is an en cyphered version of a message 
Wi ; in vector quantizers, where the "address a," is the address of a close 
approximation to data «;, ; in coded satellite transmissions, where the 
"address aj" is a data word Wi plus parity check bits for detecting and 
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correcting errors; in digital audio systems, where the "address Oj" is a 
stretch of digitized and coded music; and in computer memories, where 
Oj is an address (a coded version of a word of memory) and Wi is a word 
in memory. 

In this chapter we study three fundamental questions in the construc- 
tion of binary addresses or binary codes. First, what are plausible schemes 
for mapping symbols (such as words, letters, computer instructions, volt- 
ages, pressures, etc.) into binary codes? Second, what are plausible 
schemes for coding likely symbols with short binary words and unlikely 
symbols with long words in order to minimize the number of binary digits 
(bits) required to represent a message? Third, what are plausible schemes 
for "coding" binary words into longer binary words that contain "redun- 
dant bits" that may be used to detect and correct errors? These are not 
new questions. They have occupied the minds of many great thinkers. 
Sir Francis recognized that arbitrary messages had binary representa- 
tions. Alan Turing, Alonzo Church, and Kurt Goedel studied binary codes 
for computations in their study of computable numbers and algorithms. 
Claude Shannon, R. C. Bose, Irving Reed, Richard Hamming, and many 
others have studied error control codes. Shan- non, David Huffman, and 
many others have studied the problem of efficiently coding information. 

In this chapter we outline the main ideas in binary coding and illus- 
trate the role that binary coding plays in digital communications. In your 
subsequent courses in electrical and computer engineering you will study 
integrated circuits for building coders and decoders and mathematical 
models for designing good codes. 

7.2 Binary Codes: The Communication 
Paradigm 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

A paradigm is a pattern of ideas that form the foundation for a body 
of knowledge. A paradigm for (tele-) communication theory is a pattern 
of basic building blocks that may be applied to the dual problems of (i) 
reliably transmitting information from source to receiver at high speed or 
(ii) reliably storing information from source to memory at high density. 



2 This content is available online at <http://cnx.Org/content/m21407/l.5/>. 
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CHAPTER 7. BINARY CODES 



High-speed communication permits us to accommodate many low-rate 
sources (such as audio) or one high- rate source (such as video). High- 
density storage permits us to store a large amount of information in a 
small space. For example, a typical 1.2 Mbyte floppy disc stores 9.6 x 10 6 
bits of information, whereas a typical CD stores about 2 x 10 9 bits, enough 
for one hour's worth of high-quality sound. 



source 






source 
coder 




channel 
coder 
























(transmitter) 














channel 






(receiver) 














source 
decoder 




channel 
decoder 























Figure 7.2: Basic Building Blocks in a (Tele-) Communication 
System 



Figure 1 (Figure 7.2) illustrates the basic building blocks that apply 
to any problem in the theory of (tele-) communication. The source is 
an arbitrary source of information. It can be the time- varying voltage at 
the output of a vibration sensor (such as an integrating accelerometer for 
measuring motion or a microphone for measuring sound pressure); it can 
be the charges stored in the CCD array of a solid-state camera; it can 
be the addresses generated from a sequence of keystrokes at a computer 
terminal; it can be a sequence of instructions in a computer program. The 
source coder is a device for turning primitive source outputs into more 
efficient representations. For example, in a recording studio, the source 
coder would convert analog voltages into digital approximations using an 
A/D converter; a fancy source coder would use a fancy A/D converter 
that finely quantized likely analog values and crudely quantized unlikely 
values. If the source is a source of discrete symbols like letters and num- 
bers, then a fancy source code would assign short binary sequences to 
likely symbols (such as e) and long binary sequences to unlikely symbols 
(such as z). The channel coder adds "redundant bits" to the binary out- 
put of the source coder so that errors of transmission or storage may be 
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detected and corrected. In the simplest example, a binary string of the 
form 01001001 would have an extra bit of 1 added to give even parity 
(an even number of l's) to the string; the string 10110111 would have 
an extra bit of added to preserve the even parity. If one bit error is 
introduced in the channel, then the parity is odd and the receiver knows 
that an error has occurred. The modulator takes outputs of the channel 
coder, a stream of binary digits, and constructs an analog waveform that 
represents a block of bits. For example, in a 9600 baud Modem, five bits 
are used to determine one of 2 5 = 32 phases that are used to modulate 
the signal Acos (wt + <f). Each possible string of five bits has its own per- 
sonalized phase, <j>, and this phase can be determined at the receiver. The 
signal Acos (cut + </>) is an analog signal that may be transmitted over a 
channel (such as a telephone line, a microwave link, or a fiber-optic cable). 
The channel has a finite bandwidth, meaning that it distorts signals, and 
it is subject to noise or interference from other electromagnetic radiation. 
Therefore transmitted information arrives at the demodulator in imper- 
fect form. The demodulator uses filters matched to the modulated signals 
to demodulate the phase and look up the corresponding bit stream. The 
channel decoder converts the coded bit stream into the information bit 
stream, and the source decoder looks up the corresponding symbol. This 
sequence of steps is illustrated symbolically in Figure 7.3. 



H »>01 10 1*01 100— +-Acos{(»t-<l>[0\ 100]) -. 

T 
HM 1 1 0-* 1 1 00 <* <!"+ 



Figure 7.3: Symbolic Representation of Communication 



In your subsequent courses on communication theory you will study 
each block of Figure 1 (Figure 7.2) in detail. You will find that every 
source of information has a characteristic complexity, called entropy, that 
determines the minimum rate at which bits must be generated in order 
to represent the source. You will also find that every communication 
channel has a characteristic tolerance for bits, called channel capacity. 
This capacity depends on signal-to-noise ratio and bandwidth. When 
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the channel capacity exceeds the source entropy, then you can transmit 
information reliably; if it does not, then you cannot. 

7.3 Binary Codes: From Symbols to Binary 
Codes 3 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Perhaps the most fundamental idea in communication theory is that ar- 
bitrary symbols may be represented by strings of binary digits. These 
strings are called binary words, binary addresses, or binary codes. In 
the simplest of cases, a finite alphabet consisting of the letters or sym- 
bols So,5i, ..., Sm-i is represented by binary codes. The obvious way to 
implement the representation is to let the i th binary code be the binary 
representation for the subscript i: 

so ~ 000 = ao 
Sl ~ 001 = oi 

i (7-1) 

Sq ~ 110 = <Z6 

S7 ~ 111 = 07. 
The number of bits required for the binary code is N where 

2 JV - 1 < M < 2 N . (7.2) 

We say, roughly, that N = log 2 M. 

Octal Codes. When the number of symbols is large and the cor- 
responding binary codes contain many bits, then we typically group the 
bits into groups of three and replace the binary code by its corresponding 
octal code. For example, a seven-bit binary code maps into a three-digit 



3 This content is available online at <http://cnx.Org/content/m21399/l.7/>. 
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octal code as follows: 



0000000 - 


- 000 


0000001 - 


- 001 


0100110 - 


- 046 



(7.3) 



101111 



137 



1111111 



177. 



The octal ASCII codes for representing letters, numbers, and special 
characters are tabulated in Table 1 (Table 7.1). 

Exercise 7.1 

Write out the seven-bit ASCII codes for A,q, 7, and{. 



'() 



'1 



'2 



'3 



'4 



'5 



'6 



7 



'00x 



[U+24()0lU+24()lIU+24(l2DU+24()3DU+24(l4DU+24()5DU+24(l6DU+24()7] 



'01x 



[U+24()8lU+24()9lU+24(IADU+24()BDU+24(ICDU+24()DDU+24(IEDU+24()F] 



'02x 



[U+24 



ODU+24 



lDU+24:.2flU+24:.3DU+24 



4DU+24 



5DU+24:.6DU+24:.7] 

dDu+24:.eDu+24:.f] 



'03x 



[U+24 



8DU+24 



9DU+24:.AflU+24:.BDU+24 



CDU+24 



'04x 



[U+2420Q 



// 



% 



k 



'05x 



( 



'06x 



'07x 



< 



> 



continued on next page 



240 



CHAPTER 7. BINARY CODES 



'10x 


@ 


A 


B 


C 


D 


E 


F 


G 


'llx 


H 


I 


J 


K 


L 


M 


N 





'12x 


P 


Q 


R 


S 


T 


U 


V 


W 


'13x 


X 


Y 


Z 


[ 


\ 


] 


~ 




'14x 


i 


a 


b 


c 


d 


e 


f 


g 


'15x 


h 


i 


J 


k 


1 


m 


n 





'16x 


P 


q 


r 


s 


t 


u 


V 


w 


'17x 


X 


y 


z 


{ 


1 


} 


~ 


[U+24: 



Table 7.1: Octal ASCII Codes (from Donald E. Knuth, The TEXbook, 

©1986 by the American Mathematical Society, Providence, Rhode 

Island p. 367, published by Addison- Wesley Publishing Co.) 



Exercise 7.2 

Add a 1 or a to the most significant (left-most) position of 
the seven-bit ASCII code to produce an eight-bit code that has 
even parity (even number of l's). Give the resulting eight-bit 
ASCII codes and the corresponding three-digit octal codes for 
%, u,f,8, and +. 

Quantizers and A/D Converters. What if the source alphabet is 
infinite? Our only hope is to approximate it with a finite collection of 
finite binary words. For example, suppose the output of the source is an 
analog voltage that lies between — Vb and +Vo- We might break this peak- 
to-peak range up into little voltage cells of size jg-A and approximate the 
voltage in each cell by its midpoint. This scheme is illustrated in Figure 1 
(Figure 7.4). In the figure, the cell Cj is defined to be the set of voltages 
that fall between vzf/X^ and i^MA +^M A : 



M-M 



r iv - 2y ° V ° ^v ^ - 2Vo m V °x 
Li = {V : «•— — — < V < i^-r + — }• 



(7.4) 



MM ~ M M J 

The mapping from continuous values of V to a finite set of approximations 



Q(v) 



.2V 



if V £ Ci 



(7.5) 



2V„ 



That is, V is replaced by the quantized approximation i^ whenever V 
lies in cell Cj. We may represent the quantized values r M with binary 
codes by simply representing the subscript of the cell by a binary word. 
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In a subsequent course on digital electronics and microprocessors you will 
study A/D (analog-to-digital) converters for quantizing variables. 





~ V o 


c 






. 2V 


¥H K 




, M 


C- 2 

iii i i i 


C 2 
i i i 


T 

1 1 ! 


— i — i — i — i i i 


\ 

cell C Q 


1 1 ■ 

^0 



Figure 7.4: A Quantizer 



Example 7.1 

If M = 8, corresponding to a three-bit quantizer, we may asso- 
ciate quantizer cells and quantized levels with binary codes as 
follows: 



^eC7_ 3 


=>■ 


V_ 3 = (-3) ^ - 111 


/eC7_ 2 


=>■ 


V_ 2 = (-2) ^ ~ 110 


/eCli 


=>■ 


V.! = (-1) ^ ~ 101 


VeC 


=>■ 


y = o ~ ooo 


V ed 


^> 


Vi = (1) ?Vo ^ ooi 


VeC 2 


=>■ 


y 2 = (2) 2|o ~ 010 


VeC 3 


^> 


T/ 3 = (3) 2|o ^ oil. 



(7.6) 
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This particular code is called a sign-magnitude code, wherein 
the most significant bit is a sign bit and the remaining bits are 
magnitude bits (e.g., 110 ~ —2 and 010 ~ 2). One of the defects 
of the sign-magnitude code is that it wastes one code by using 
000 for and 100 for-O. An alternative code that has many other 
advantages is the 2's complement code. The 2s complement 
codes for positive numbers are the same as the sign-magnitude 
codes, but the codes for negative numbers are generated by com- 
plementing all bits for the corresponding positive number and 
adding 1: 



-4- 


- 100 




-3- 


- 101 


(100+ 1 


"2 r 


- 110 


(101+1 


-1 - 


- Ill 


(110+1 


0- 


-000 




1 - 


^001 




2- 


^010 




3~ 


011. 





(7.7) 



Exercise 7.3 

Generate the four-bit sign-magnitude and four-bit 2's comple- 
ment binary codes for the numbers —8, —7, ..., —1, 0, 1,2, ..., 7. 

Exercise 7.4 

Prove that, in the 2s complement representation, the binary 
codes for —nand + n sum to zero. For example, 

101 + 011 = 000 
(-3) (3) (0). 

In your courses on computer arithmetic you will learn how to do arithmetic 
in various binary-coded systems. The following problem illustrates how 
easy arithmetic is in 2's complement. 

Exercise 7.5 

Generate a table of sums for all 2's complement numbers be- 
tween —4 and +3. Show that the sums are correct. Use 
+ = 0, + 1 = 1,1 + 0= 1, and 1 + 1 =0 with a carry 
into the next bit. For example, 001 + 001 = 010. 
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Binary Trees and Variable-Length Codes. The codes we have con- 
structed so far are constant-length codes for finite alphabets that contain 
exactly M = 2 N symbols. In the case where M = 8 and N = 3, then 
the eight possible three-bit codes may be represented as leaves on the 
branching tree illustrated in Figure 2(a) (Figure 7.5). The tree grows a 
left branch for a and a right branch for a 1, until it terminates after 
three branchings. The three-bit codes we have studied so far reside at the 
terminating leaves of the binary tree. But what if our source alphabet 
contains just five symbols or letters? We can represent these five symbols 
as the three-bit symbols 000 through 100 on the binary tree. This gen- 
erates a constant-length code with three unused, or illegal, symbols 101 
through 111. These are marked with an "x" in Figure 2(a) (Figure 7.5). 
These unused leaves and the branches leading to them may be pruned to 
produce the binary tree of Figure 2(b) (Figure 7.5). 

If we admit variable-length codes, then we have several other options 
for using a binary tree to construct binary codes. Two of these codes and 
their corresponding binary trees are illustrated in Figure 3 (Figure 7.6). 
If we disabuse ourselves of the notion that each code word must contain 
three or fewer bits, then we may construct binary trees like those of Figure 
4 (Figure 7.7) and generate their corresponding binary codes. In Figure 
4(a) (Figure 7.7), we grow a right branch after each left branch and label 
each leaf with a code word. In Figure 4(b) (Figure 7.7), we prune off the 
last right branch and associatea code word with the leaf on the last left 
branch. 




(a) 

Figure 7.5: Binary Trees and Constant-Length Codes; (a) Binary 
Tree, and (b) Pruned Binary Tree 



All of the codes we have generated so far are organized in Table 2 (Ta- 
ble 7.2). For each code, the average number of bits/symbol is tabulated. 
This average ranges from 2.4 to 3.0. If all symbols are equally likely to 
appear, then the best variable-length code would be code 2. 



244 CHAPTER 7. BINARY CODES 



(a) (b) 

Figure 7.6: Binary Trees and Variable-Length Codes; (a) Binary 
Tree for Variable-length Code, and (b) Another Binary Tree for 
Variable-length Code 



All of the codes we have constructed have a common characteristic: 
each code word is a terminating leaf on a binary tree, meaning that no 
code word lies along a limb of branches to another code word. We say 
that no code word is a prefix to another code word. This property makes 
each of the codes instantaneously decodable, meaning that each bit in a 
string of bits may be processed instantaneously (or independently) with- 
out dependence on subsequent bits. 

Exercise 7.6 

Decode the following sequence of bits using code 2: 

0111001111000000101100111. (7.9) 
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# 
(a) 




(So) 



GO 



Figure 7.7: Left-Handed Binary Trees for Variable-Length Codes; 
(a) Left-handed Binary Tree, and (b) Pruned Binary Tree 





Code 

# 


So 


Si 


s 2 


s 3 


04 


Average 
Bits/Sy 


1 


000 


001 


010 


Oil 


100 


15/5 = 
3.0 


2 


000 


001 


01 


10 


11 


12/5 = 
2.4 








continued on next pi, 


ge 
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3 


000 


001 


010 


Oil 


1 


13/5 = 
2.6 


4 


1 


01 


001 


0001 


00001 


15/5 = 
3.0 


5 


1 


01 


001 


0001 


0000 


14/5 = 
2.8 



Table 7.2: Variable Length Codes 

Exercise 7.7 

Illustrate the following codes on a binary tree. Which of them 
are instantaneously decodable? Which can be pruned and re- 
main instantaneously decodable? 



So Si S2 S3 S4 

011 100 00 11 101 

011 100 00 01 

010 000 100 101 111. 



(7.10) 



Code #2 generated in Table 2 (Table 7.2) seems like a better code than 
code #5 because its average number of bits/symbol (2.4) is smaller. But 
what if symbol So is a very likely symbol and symbol S4 is a very unlikely 
one? Then it may well turn out that the average number of bits used by 
code #5 is less than the average number used by code #2. So what is the 
best code? The answer depends on the relative frequency of use for each 
symbol. We explore this question in the next section. 



7.4 Binary Codes: Huffman Codes for Source 
Coding 4 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In 1838, Samuel Morse was struggling with the problem of designing an ef- 
ficient code for transmitting information over telegraph lines. He reasoned 



4 This content is available online at <http://cnx.Org/content/m21404/l.8/>. 
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that an efficient code would use short code words for common letters and 
long code words for uncommon letters. (Can you see the profit motive 
at work?) In order to turn this reasoned principle into workable prac- 
tice, Morse rummaged around in the composition trays for typeface in a 
printshop. He discovered that typesetters use many more e ' s than s's. He 
then formed a table that showed the relative frequency with which each 
letter was used. His ingenious, variable-length Morse code assigned short 
codes to likely letters (like "dot" for e ) and long codes to unlikely letters 
(like "dash dash dot dot" for z). We now know that Morse came within 
about 15% of the theoretical minimum for the average code word length 
for English language text. 

A Variation on Morse's Experiment. In order to set the stage for 
our study of efficient source codes, let's run a variation on Morse's exper- 
iment to see if we can independently arrive at a way of designing codes. 
Instead of giving ourselves a composition tray, let's start with a communi- 
cation source that generates five symbols or letters 5o, S\, £2, S3, S4. We 
run the source for 100 transmissions and observe the following numbers 
of transmissions for each symbol: 



50 S s 


20 S[s 


20S' 2 s 


5 S 3 s 


5 S 4 s. 



(7.11) 



We will assume that these "source statistics" are typical, meaning that 
1000 transmissions would yield 500 S' s and so on. 

The most primitive binary code we could build for our source would 
use three bits for each symbol: 



So r 


-000 


Si' 


-001 


S 2 r 


-010 


S 3 r 


-011 


O4 r 


- 100 


X r. 


^ 101 


X r. 


^ 110 


X ~ 


' 111. 



(7.12) 
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This code is inefficient in two ways. First, it leaves three illegal code words 
that correspond to no source symbol. Second, it uses the same code word 
length for an unlikely symbol (like £4) that it uses for a likely symbol 
(like So). The first defect we can correct by concatenating consecutive 
symbols into symbol blocks, or composite symbols. If we form a composite 
symbol consisting of M source symbols, then a typical composite symbol 
is S'iS'oS'iS^S^S'sS'iS^'S'o- The number of such composite symbols that 
can be generated is 5 M . The binary code for these 5 M composite symbols 
must contain N binary digits where 



iJV-l 



< 5 M < 2 N (TV S Mlog 2 b) . 



The number of bits per source symbol is 



N 
M 



log 2 5 = 2.32. 



(7.13) 



(7.14) 



This scheme improves on the best variable length code of Table 2 from 
"Binary Codes: From Symbols to Binary Codes" (Table 7.2) by 0.08 
bits/symbol. 

Exercise 7.8 

Suppose your source of information generates the 26 lowercase 
roman letters used in English language text. These letters are to 
be concatenated into blocks of length M. Complete the following 
table of JV (number of bits) versus M (number of letters in a 
block) and show that || approaches log 2 26. 





M 




1 


2 


3 


4 


5 


6 


N 


5 


10 










N/M 


5 


5 











Table 7.3 

Now let's reason, as Morse did, that an efficient code would use short 
codes for likely symbols and long codes for unlikely symbols. Let's pick 
code #5 from Table 2 from "Binary Codes: From Symbols to Binary 
Codes" (Table 7.2) for this purpose: 



So Si S 2 S3 S4 
1 01 001 0001 0000. 



(7.15) 
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This is a variable-length code. If we use this code on the 100 symbols 
that generated our source statistic, the average number of bits/symbol is 



1 
100 



[50 (1) + 20 (2) + 20 (3) + 5 (4) + 5 (4)] = 1.90bits/symbol. (7.16) 



Exercise 7.9 

Use the source statistics of Equation 1 (7.11) to determine the 
average number of bits/symbol for each code in Table 2 from 
"Binary Codes: From Symbols to Binary Codes" (Table 7.2). 

Entropy. So far, each ad hoc scheme we have tried has produced an 
improvement in the average number of bits/symbol. How far can this go? 
The answer is given by Shannon's source coding theorem, which says that 
the minimum number of bits/symbol is 



N 
M 



M 



> 



^Pilog 2 Pi 



(7.17) 



i=\ 



where p; is the probability that symbol S; is generated and — ^Pilog 2 Pi is 
a fundamental property of the source called entropy. For our five-symbol 
example, the table of p; and —logpi is given in Table 2 (Table 7.4). The 
entropy is 1.861, and the bound on bits/symbol is 



N 
M 



> 1.861. 



(7.18) 



Code #5 comes within 0.039 of this lower bound. As we will see in the 
next paragraphs, this is as close as we can come without coding composite 
symbols. 



Symbol 


Probability 


~ Log Probability 


So 


0.5 


1 


Si 


0.2 


2.32 


s 2 


02 


2.32 


S 3 


0.05 


4.32 


04 


0.05 


4.32 



Table 7.4: Source statistics for Five-Symbol Source 
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Exercise 7.10 

Select an arbitrary page of English text. Build a table of source 
statistics containing p t (relative frequencies) and-log pi for a 
through z. (Ignore distinction between upper and lower case 
and ignore punctuation and other special symbols.) Compute 
the entropy - Y<i=iPi lo 92Pi- 
Huffman Codes. In the late 1950s, David Huffman discovered an al- 
gorithm for designing variable-length codes that minimize the average 
number of bits/symbol. Huffman's algorithm uses a principle of opti- 
mality that says, "the optimal code for M letters has imbedded in it the 
optimal code for the M — \ letters that result from aggregating the two 
least likely symbols." When this principle is iterated, then we have an 
algorithm for generating the binary tree for a Huffman code: 

i. label all symbols as "children"; 

ii. "twin" the two least probable children and give the twin the sum of 
the probabilities: 



(0.10) 




(S A ) (S3) 

(0.05) (0.05) 

Figure 7.8 



iii. (regard the twin as a child; and 

iv. repeat steps (ii) and (iii) until all children are accounted for. 

This tree is now labeled with l's and 0's to obtain the Huffman code. The 
labeling procedure is to label each right branch with a 1 and each left 
branch with a 0. The procedure for laying out symbols and constructing 
Huffman trees and codes is illustrated in the following examples. 
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Example 7.2 

Consider the source statistics 



Symbol So Si S2 S3 S4 
Probability 0.5 0.2 0.2 0.05 0.05 



(7.19) 



for which the Huffman algorithm produces the following binary 
tree and its corresponding code: 




Figure 7.9 



Example 7.3 

The Huffman code for the source statistics 

Symbol S Si S2 S3 S4 

Probability 0.75 0.075 0.075 0.05 0.05 
is illustrated next: 



(7.20) 
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Figure 7.10 



Exercise 7.11 

Generate binary trees and Huffman codes for the following 
source statistics: 



Symbol^ o 5'i^25'354555 6 57ProbabilitylO.2OO.2OO.15O.15O.](0.11).O5O.O5I 

Coding a FAX Machine. Symbols can arise in unusual ways and be 
defined quite arbitrarily. To illustrate this point, we consider the design 
of a hypothetical FAX machine. For our design we will assume that a 
laser scanner reads a page of black and white text or pictures, producing 
a high voltage for a black spot and a low voltage for a white spot. We 
will also assume that the laser scanner resolves the page at 1024 lines, 
with 1024 spots/line. This means that each page is represented by a two- 
dimensional array, or matrix, of pixels (picture elements), each pixel being 
1 or 0. If we simply transmitted these l's and O s, then we would need 
1024 x 1024 = 1, 059, 576 bits. If these were transmitted over a 9600 baud 
phone line, then it would take almost 2 minutes to transmit the FAX. 
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This is a long time. 

Let's think about a typical scan line for a printed page. It will con- 
tain long runs of O's, corresponding to long runs of white, interrupted by 
short bursts of l's, corresponding to short runs of black where the scan- 
ner encounters a line or a part of a letter. So why not try to define a 
symbol to be "a run of k O's" and code these runs? The resulting code is 
called a "run length code." Let's define eight symbols, corresponding to 
run lengths from to 7 (a run length of is a 1): 

So = run length of zeros (a 1) 
Si = run length of 1 zero 

5V = run legnth of 7 zeros. 



(7.22) 



If we simply used a simple three-bit binary code for these eight symbols, 
then for each scan line we would generate anywhere from 3 x 1024 bits (for 
a scan line consisting of all l's) to 3 x 1024/7 = 400 bits (for a scan line 
consisting of all O's). But what if we ran an experiment to determine the 
relative frequency of the run lengths So through SV and used a Huffman 
code to "run length encode" the run lengths? The following problem 
explores this possibility and produces an efficient FAX code. 

Exercise 7.12 

An experiment conducted on FAXed documents produces the 
following statistics for run lengths of white ranging from to 7: 



(7.23) 



These statistics indicate that only 1% of a typical page is black. 
Construct the Huffman code for this source. Use your Huffman 
code to code and decode these scan lines: 



i i i i i i i i i i i i i i i i i i i i i i i «««« i i i i « 



Symbol 


So 


Si 


s 2 


s 3 


04 


s 5 


So 


S 7 


Probability 


0.01 


0.06 


0.1 


0.1 


0.2 


0.15 


0.15 


0.2 



Figure 7.11 
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7.5 Binary Codes: Hamming Codes for Chan- 
nel Coding 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The idea behind Hamming codes is to intersperse, or append, extra binary 
digits to a binary code so that errors in transmission of the code over a 
channel may be detected and corrected. For example, suppose we transmit 
the code 01101001, and it is received as 01001001. In this transmission, 
the third most significant bit is received erroneously. Let's define the 
following "modulo-2 addition" of binary numbers: 

000 = 

001=1 , 

(7.24) 

100=1 
101 = 0. 

Multiplication in modulo-2 arithmetic is simply 0-0 = 0-1 = 1-0 = and 
1-1 = 1. Then we can say that the error sequence 00100000 is "added" 
to the transmission 01101001 to produce the erroneous reception: 

01101001 transmitted 
© 00100000 error (7.25) 

01001001 received. 

Hamming error correcting codes will permit us to receive the erroneous 
transmission and to detect and correct the error. This is obviously of 
great value in transmitting and storing information. (Imagine how upset 
you would be to have the binary code for your checking account confused 
with that of Mrs. Joan Kroc.) 

Choosing the Number of Check Bits. Let's suppose we have 
N bits of information that we wish to transmit and that we wish to 



5 This content is available online at <http://cnx.Org/content/m21403/l.5/>. 
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intersperse "check bits" that will enable us to detect and correct any single 
bit error in the transmission. If we use TV information bits and n check 
bits, then we will transmit a code word containing N+n bits. The n check 
bits can code 2™ events, and we want these events to indicate whether or 
not any errors occurred and, if so, where they occurred. Therefore we 
require 

where (TV + n) is the number of single error events that can occur 
and +1 is the number of no-error events. For example, when TV = 4, we 
require n = 3 so that 2 3 > (4 + 3) + 1. 

How many check bits do you require to code seven bits of information 
for single error correction? 

Code Construction. Let's suppose we have constructed an (N,n) 
Hamming code consisting of TV information bits and n check bits (or 
parity bits). We denote the information bits by X\,X2, ...,Xn and the 
check bits by c\, C2, ..., c n . These bits may be interspersed. When TV = 4 
and n = 3, then a typical array of bits within a code word would be one 
of the following: 



Cl 




Xl 


C2 




%2 


Xl 




X3 


C3 


or 


£4 


X2 




Cl 


%3 




C2 


X4 




C 3 



(7.26) 



The first ordering is "natural" (as we will see), and the second is "system- 
atic" (a term that is used to describe any code whose head is information 
and whose tail is check). If a single error occurs in an (TV, n) code, then 
the received code word will be the modulo-2 sum of the code word and 
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the error word that contains a 1 in its i position: 



Cl 




' o " 


C2 







Xl 







C3 


e 


I 


X2 







%3 







X4 




_ _ 



(7.27) 



We would like to operate on this received code word in such a way that 
the location of the error bit can be determined. If there were no code 
word, then an obvious solution would be to premultiply the error word 
by the parity check matrix 



10 10 10 1 
110 11 
1111 

(1) (2) (3) (4) (5) (6) (7) ] 



(7.28) 



The i th column of A T is just the binary code for i. When A T premultiplies 
an error word, the error bit picks out the column that codes the error 
position: 



1 


10 10 1" 




■o- 




"0" 







110 11 

















1111. 









_1_ 






position 4 — + 


1 


= T 









binary code for 









position 4 






.0. 






Fig 


ure 


7. 


12 
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If the error word contains no error bits, then the product is 0, indi- 
cating no errors. 

This seems like a good idea, but what about the effect of the code 
word? In Exercise 1 (Exercise 7.13), you are asked to show that the effect 
of the parity check matrix A T applied to the modulo-2 sum of a code 
word x and an error word e is 

A T (x®e) = A T x © A T e. (7.29) 

In this equation all sums and products obey the rules of modulo-2 arith- 
metic. 

Exercise 7.13 

Let y = x © e denote the modulo-2 sum of a code word x and 
an error word e; A T is a parity check matrix. Show that 



A T y = A T x © A T e. 



(7.30) 



We have designed the parity check matrix A T so that the syndromeA T e 
produces a binary code for the error location. (The location of the error 
is the syndrome for the error word.) The product A T x will interfere with 



this syndrome unless A 
word x satisfy the constraint 



0. Therefore we will require that the code 



0. 



(7.31) 



This constraint actually defines the Hamming code. Let's illustrate this 
point by applying the constraint to a code word in its "natural format" 



X 1 =(c\C?.X\C%XiXzX4). 



Natural Codes. When the information bits and the check bits are 
coded in their natural order (C1C2X1C3X2X3X4), then we may determine 
the check bits by writing A T x as follows: 



10 10 10 1 
110 11 
1111 





Cl 






C2 






Xl 









C3 


= 







X2 









X3 






X4 







(7.32) 
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We use the rules of modulo-2 arithmetic to write these constraints as 

ci e xi © x 2 © x 4 = o 

c 2 © xi © x 3 © £4 = (7.33) 

c 3 © x 2 © x 3 © x 4 = 0. 

Therefore the check bits Ci,C2, and C3 are simply the following modulo-2 
sums 



ci = X\ © x 2 © X4 
c 2 = Xl © X3 © £4 
C3 = X 2 © £3 © X4- 

This finding may be organized into the matrix equation 



(7.34) 



Cl 




' 1101 " 




c 2 




1011 




p. 1 


Xl 




1000 




Xl 


C3 


= 


0111 




X2 


x 2 




0100 




X3 


X3 




0010 




X4 


X4 




. GO 01 . 







(7.35) 



This equation shows how the code word x is built from the information 
bits (xi,X2,Xs,X4). We call the matrix that defines the construction a 
coder matrix and write it as H: 



x = H@ 

t T = (C1C2X1CZX2X3X4) 9 T 

1101 
1011 
1000 

/:/ = 0111 

0100 
0010 
0001 



(X1X 2 X3X4) 



(7.36) 



(7.37) 
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This summarizes the construction of a Hamming code x. 

Exercise 7.14 

Check to see that the product of the parity check matrix A T 
and the coder matrix H is A T H = 0. Interpret this result. 

Exercise 7.15 

Fill in the following table to show what the Hamming (4, 3) 
code is: 



Xl 


Xl 


x 3 


a; 4 


Cl 


C-2 


X\ 


C3 


x 2 


x 3 


x 4 












































1 


1 


1 





1 








1 








1 

























1 


1 



















1 

























1 





1 



















1 


1 






















1 


1 


1 
















1 

























1 








1 
















1 





1 



















1 





1 


1 
















1 


1 






















1 


1 





1 
















1 


1 


1 



















1 


1 


1 


1 

















(7.38) 



Exercise 7.16 

Design a Hamming (11, n) code for coding eleven information 
bits against single errors. Show your equations for ci, C2, ..., c„ 
and write out the coder matrix H for x = HQ. 

Decoding. To decode a Hamming code, we form the syndrome A T y 
for the received (and possibly erroneous) code word y = x © e. Because 
A T x = 0, the syndrome is 

s = A T e. (7.39) 
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Convert this binary number into its corresponding integer location and 
change the bit of y in that location. If the location is zero, do nothing. 
Now strip off the information bits. This is the decoding algorithm. 

Exercise 7.17 

Use the table of Hamming (4,3) codes from Exercise 3 (Ex- 
ercise 7.15) to construct a table of received codes that contain 
either no bit errors or exactly one bit error. Apply the decoding 
algorithm to construct (xi, X2, X3, £4) and show that all received 
code words with one or fewer errors are correctly decoded. 

Digital Hardware. The tables you have constructed in Exercise 3 (Ex- 
ercise 7.15) and 5 (Exercise 7.17) for coding and decoding Hamming (4, 3) 
codes may be stored in digital logic chips. Their functionality is illustrated 
in Figure 1 (Figure 7.13). The coder chip accepts (X1X2X3X4) as its address 
and generates a coded word. The decoder chip accepts (C1C2X1C3X2X3X4) 
as its address and generates a decoded word. In your courses on digital 
logic you will study circuits for implementing coders and decoders. 




Figure 7.13: Digital Logic for Hamming Code 



Exercise 7.18 

Discuss the possibility of detecting a received (4, 3) code word 
that is neither a valid code word nor a code word with a single 
error. How would you use such a detector? 

Exercise 7.19 

What fraction of received seven-bit words can be correctly de- 
coded as Hamming (4, 3) codes? 

Systematic Codes. Systematic Hamming codes are codes whose infor- 
mation bits lead and whose check bits trail. The format for a (4, 3) code 
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is then {xxx^x^x ^cic^cj,) . The construction of a (4, 3) code word from the 
information bits may be written as 



X\ 
X2 
X3 
Xi 

C3 



1 














1 














1 














1 


Cll 


Cl2 


Cl3 


C14 


C21 


C22 


C23 


C24 


C'il 


C32 


C33 


C34 



Xl 
X2 
X3 

a; 4 



(7.40) 



The coder matrix takes the form 



H 



1 














1 














1 














1 


Cll 


C12 


Cl3 


C14 


C21 


C22 


C23 


C24 


C31 


C32 


C33 


C34 



c 



(7.41) 



The problem is to find the matrix C that defines the construction of 
check bits. The constraint A T x = produces the constraint A T H = so 
that A T HQ = 0. The constraints A T H = may be written out as 
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10 10 10 1 

{0110011} 

1111 



10 

10 

10 

1 

Cll C12 C13 c u 

c 21 C22 C23 C24 

C3I C32 C33 C34 



(7.42) 









These constraints produce all the equations we need (twelve equations 
in twelve unknowns) to determine the Cij. 

Exercise 7.20 

Solve Equation 19 (7.42) for the cy. Show that the coder matrix 
for a systematic Hamming (4, 3) code is 

10 
10 
10 
/-/ - 1 • (7.43) 

111 
10 11 
^110 1 

Exercise 7.21 

Show that the coder matrix of Exercise 7 (Exercise 7.19) is a 
permutation of the coder matrix in Equation 14 (7.37). (That 
is, the rows are reordered.) 

Exercise 7.22 

(MATLAB) Write a MATLAB program that builds Hamming 
(4, 3) codes from information bits (a^ia^a^a^) and decodes Ham- 
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ming (4, 3) codes (C1C2X1C3X2X3X4) to obtain information bits 
(xiX2X3a;4). Synthesize all seven-bit binary codes and show that 
your decoder correctly decodes correct codes and one-bit error 
codes. 



7.6 Binary Codes: Numerical Experiment 
(Huffman Codes) 6 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

The paragraph below (Gettysburg Address, p. 263) contains Lincoln's 
Gettysburg Address. Ignore special symbols like periods and ignore the 
distinction between lowercase and uppercase letters. Compute the relative 
frequency of occurrence for each of the 26 letters of the alphabet. Write 
a MATLAB program to generate a binary tree for the Huffman code of 
the Gettysburg Address. When you have generated the code, compute 
the average code word length 

26 

i n 



L = H> ( 7 " 44 ) 



<N 

i=l 

where ^ is the relative frequency for symbol i and ^ is the code word 
length for symbol i. Compare L with the entropy 

H =-f:>^=f:>3i- (^5) 

*-~>N a2 N t—'N az n,i v ; 

i— 1 i— 1 

and compare L to log 2 26- Interpret your findings. 
Gettysburg Address 



Fourscore and seven years ago, our fathers brought forth upon this 
continent a new nation, conceived in liberty and dedi- 
cated to the proposition 
that all men are created equal. Now we are engaged in a great civil war, 



6 This content is available online at <http://cnx.Org/content/m21406/l.5/>. 
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testing whether that nation or any nation so conceived and so dedi- 
cated can 

long endure. We are met on a great battlefield of that war. We have come 
to dedicate a portion of that field as a final resting-place for those who have 
given their lives that that nation might live. It is altogether fit- 
ting and proper 

that we should do this. But in a larger sense, we cannot dedi- 
cate, we cannot 

consecrate, we cannot hallow this ground. The brave men, living and dead, 
who struggled here have consecrated it far above our power to add or detract. 
The world will little note nor long remember what we say here, but it can 
never forget what they did here. It is for us the liv- 
ing rather to be dedicated 

here to the unfinished work which they who fought here have thus far so nobly 
advanced. It is rather for us to be here dedi- 
cated to the great task remaining 

before us— that from these honored dead we take increased devotion to that 
cause for which they gave the last full measure of devotion—that we here 
highly resolve that these dead should not have died in vain, that this nation 
under God shall have a new birth of freedom, and that government of the 
people, by the people, for the people shall not perish from the Earth. 
-Abraham Lincoln, November 19, 1863 



Chapter 8 

An Introduction to 
MATLAB 



8.1 An Introduction to MATLAB: 
Introduction 1 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Acknowledgment: This appendix, written with assistance from Cedric J. 
Demeure and Peter Massey, was inspired by the MATLAB user's manual 
from The MATHWORKS, Inc. The MA TLAB Primer, available through 
the MATLAB User's Group, is a useful learning aid for teachers and 
students. To join the MATLAB User's Group, send your request via 
E-mail to matlab-users request@mcs.anl.gov. 

8.1.1 Introduction 

MATLAB stands for "Matrix Laboratory." It is a computing environment 
specifically designed for matrix computations. The program is ideally 
suited to circuit analysis, signal processing, filter design, control system 
analysis, and much more. Beyond that, its versatility with complex num- 
bers and graphics makes it an attractive choice for many other program- 



1 This content is available online at <http://cnx.Org/content/m21391/l.4/>. 
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ming tasks. MATLAB can be thought of as a programming language like 
PASCAL, FORTRAN, C, or BASIC. Like most versions of BASIC, MAT- 
LAB can be used in an interactive mode wherein statements are executed 
immediately as they are typed. Alternatively, a program can be written 
in advance and saved to a disc file using an editor and then executed in 
MATLAB. You will find both modes of operation useful. 

8.2 An Introduction to MATLAB: Running 
MATLAB (Macintosh) 2 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In order to run MATLAB on a Macintosh SE or PLUS computer, you 
need the program called EDU-MATLAB. The program requires at least 1 
Mbyte of memory, System 3.0 or above, Finder version 3.0 or above, and 
an 800K drive. A hard disc drive is highly recommended. In order to run 
MATLAB on a Macintosh II, IIx, Ilex, or SE /30, you need the program 
called MacII-MATLAB, and the same system requirements apply. 

To start MATLAB, you may need to open the folder containing the 
MATLAB program. Then just "double-click" the program icon or the 
program name (for example, EDU-MATLAB). Figure A.l shows a typ- 
ical organization of the folder containing Mac II-MATLAB. It contains 
the main program, the settings file, the demonstrations folder, and any 
toolbox folders. The double-click on Mac II-MATLAB produces the Com- 
mand window as shown in Figure A. 2. You will also see a Graph window 
partially hidden behind it. (The fact that the window is not in ffont 
means that it is opened but not currently active.) If you do not know 
what "clicking," "dragging," "pop-up menu," and "trash" mean, you should 
stop reading now and familiarize yourself with the Macintosh. 



2 This content is available online at <http://cnx.Org/content/m21394/l.4/>. 
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Figure 8.1: The MATLAB Folder (Computer, Inc., used with 
permission.) 



In the command window, you should see the prompt 3>. The program 
interpreter is waiting for you to enter instructions. At this point it is 
a good idea to run the demonstration programs that are available in the 
"About MATLAB" menu under the Apple menu. Just click on the "demos" 
button and select a demo. During pauses, strike any key to continue. 
Whenever you have a MATLAB file in any folder, then you may double- 
click the file to launch the program. This allows you to have your own 
folder containing your own MATLAB files, separated from the MATLAB 
folder. 
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4t File Edit Workspace M-File Format Window 




Figure 8.2: The Command Window (Computer, Inc., used with 
permission.) 



MATLAB has four types of windows: 

i. Command for computing, programming, and designing in- 
put/output displays; 

ii. Graph for displaying plots and graphs; 
iii. Edit for creating and modifying your own files; and 
iv. Help for getting on-line help and for running demos. 

All windows follow the traditional behavior of Macintosh windows. You 
can resize them (actually the help window has a fixed size) or move them. 
For more details on menus and windows, see the Macintosh and MATLAB 
manuals. 



8.3 An Introduction to MATLAB: Running 
MATLAB (PC) 3 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 



3 This content is available online at <http://cnx.Org/content/m21393/l.4/>. 
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for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In order to run MATLAB (Version 3.5) on an IBM or compatible 
personal computer, you must have a floating point math coprocessor 
(80a;87)installed and at least 512 kbytes of memory. The program is 
called PCMAT-LAB.EXE, but it is usually invoked via the batch file 
MATLAB.BAT in the MATLAB subdirectory. If you are using a menu 
system and MATLAB is one of your choices, just choose it. Otherwise, 
go to the MATLAB suiUirectory and type MATLAB. 

You may be able to usea more powerful implementation of MATLAB 
if you have an 80286 or 80386 machine. AT-MATLAB runs on an 80286 
with at least 1 Mbyte of extended memory. AT-MATLAB is distributed 
with PC-MATLAB. 386-MATLAB, a special version for 80386 or 80486 
machines with virtual memory support and no limits on variable size, is 
sold separately. 

When you run MATLAB, you should see the prompt 3>. The pro- 
gram interpreter is waiting for you to enter instructions. Some MATLAB 
instructions, such as plot, are graphics-type instructions which plot re- 
sults and data. Execution of one of these graphics instructions puts the 
PC screen into the graphics mode, which displays the resulting plot. No 
instructions can be executed in the graphics mode other than a screen- 
dump function. Striking any other key will return the PC to the command 
mode, but the graphics are temporarily stored (like variables) and can be 
recalled by the shg (show graphics) instruction. If you wish, you may run 
some of the demonstration programs now by entering demo and following 
the on-screen instructions. 



8.4 An Introduction to MATLAB: Interactive 
Mode 4 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In command mode, MATLAB displays a prompt (^>) and waits for your 
input. You may type any legal mathematical expression for immediate 



This content is available online at <http://cnx.Org/content/m21390/l.4/>. 
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evaluation. Try the following three examples (press "enter" or "return" at 
the end of each line) : 

> 2+2 

> 5-2 

> 2*sin(pi/4) 

The variable pi = 3. 14 is built into MATLAB, as are the sin function 
and hundreds of other functions. When you entered each of the preceding 
lines, MATLAB stored the results in a variable called ans for answer. The 
value of ans was then displayed. The last line should have produced the 
square root of 2. We can manipulate ans to find out 

> ans~2 

The new answer is very close to 2, as expected. Let's see what the roundoff 
error is: 



> ans-2 



8.5 An Introduction to MATLAB: Variables 5 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

Any result you wish to keep for a while may be assigned to a variable 
other than ans: 

> x = pi/7 

> cos(x) 

> y = sin(x)~2+cos(x)~2; 

> y 

A semicolon (;) at the end of the line suppresses printing of the result, 
as when we calculated y in the next-to-last line just shown. This feature 
is especially useful when writing MATLAB programs where intermediate 
results are not of interest and when working with large matrices. 



5 This content is available online at <http://cnx.Org/content/m21397/l.4/>. 
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MATLAB supports the dynamic creation of variables. You can create 
your own variables by just assigning a value to a variable. For example, 
type x = 3 . 5+4 . 2. Then the real variable x contains the value 7 . 7. Vari- 
able names must start with an alphabetical character and be less than 
nineteen characters long. If you type x = -3*4.0, the content 7.7 is re- 
placed by the value -12. Some commands allow you to keep track of all 
the variables that you have already created in your session. Type who 
or whos to get the list and names of the variables currently in memory 
(whos gives more information than who). To clear all the variables, type 
in clear. To clear a single variable (or several) from the list, follow the 
command clear by the name of the variable you want to delete or by a 
list of variable names separated by spaces. Try it now. 

MATLAB is case sensitive. In other words, x and X are two different 
variables. You can control the case sensitivity of MATLAB by entering the 
command casesen, which toggles the sensitivity. The command casesen 
on enforces case sensitivity, and casesen off cancels it. 

If one line is not enough to enter your command, then finish the first 
line with two dots ( . . and continue on the next line. You can enter 
more than one command per line by separating them with commas if you 
want the result displayed or with semicolons if you do not want the result 
displayed. For example, type 

3> theta = pi/7; x = cos(theta); y = sin(theta) ; 
> x,y 

to first compute theta, cos (theta), and sin(theta) and then to print x 
and y. 

8.6 An Introduction to MATLAB: Complex 
Variables 6 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 



The number y/—l is predefined in MATLAB and stored in the two variable 
locations denoted by i and j. This double definition comes from the 
preference of mathematicians for using i and the preference of engineers 



6 This content is available online at <http://cnx.Org/content/m21384/l.4/>. 
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for using j (with i denoting electrical current), i and j are variables, and 
their contents may be changed. If you type j = 5, then this is the value 
for j and j no longer contains \J — 1. Type in j = sqrt(-l) to restore 
the original value. Note the way a complex variable is displayed. If you 
type i, you should get the answer 

i = 
0+1.0000i. 

The same value will be displayed for j. Try it. Using j, you can now enter 
complex variables. For example, enter zl = 1+2* j and z2 = 2+1. 5* j. 
As j is a variable, you have to use the multiplication sign *. Otherwise, 
you will get an error message. MATLAB does not differentiate (except 
in storage) between a real and a complex variable. Therefore variables 
may be added, subtracted, multiplied, or even divided. For example, type 
in x = 2, z = 4.5*j , and z/x. The real and imaginary parts of z are 
both divided by x. MATLAB just treats the real variable x as a complex 
variable with a zero imaginary part. A complex variable that happens to 
have a zero imaginary part is treated like a real variable. Subtract 2*j 
from zl and display the result. 

MATLAB contains several built-in functions to manipulate complex 
numbers. For example, real (z) extracts the real part of the complex 
number z. Type 

> z = 2+1. 5* j , real(z) 
to get the result 

z = 

2.000+1.500i 

ans = 

2 

Similarly, imag(z) extracts the imaginary part of the complex number z. 
The functions abs(z) and angle (z) compute the absolute value (magni- 
tude) of the complex number z and its angle (in radians). For example, 
type 

> z = 2+2* j; 
3> r = abs(z) 

3> theta = angle (z) 
3> z = r*exp(j*theta) 
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The last command shows how to get back the original complex number 
from its magnitude and angle. This is clarified in Chapter 1: Complex 
Numbers. 

Another useful function, conj (z), returns the complex conjugate of 
the complex number z. If z = x+j*y where x and y are real, then conj 
(z) is equal to x-j*y. Verify this for several complex numbers by using 
the function conj (z). 

8.7 An Introduction to MATLAB: Vectors and 
Matrices 7 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

As its name indicates, MATLAB is especially designed to handle matrices. 
The simplest way to enter a matrix is to use an explicit list. In the list, 
the elements are separated by blanks or commas, and the semicolon (;) 
is used to indicate the end of a row. The list is surrounded by square 
brackets [ ]. For example, the statement 

> A = [1 2 3;4 5 6;7 8 9] 

results in the output 

A = 
12 3 
4 5 6 
7 8 9 

The variable A is a matrix of size 3x3. Matrix elements can be any 
MATLAB expression. For example, the command 

> x = [-1.3 sqrt(3) (1+2+3) +4/5] 

results in the matrix 

x = 
-1.3000 1.7321 4.8000 



7 This content is available online at <http://cnx.Org/content/m21398/l.5/>. 
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We call a matrix with just one row or one column a vector, and a 1 x 1 
matrix is a scalar. Individual matrix elements can be referenced with 
indices that are placed inside parentheses. Type x(5) = abs(x(l)) to 
produce the new vector 

x = 
-1.3000 1.7321 4.8000 0.000 1.3000 

Note that the size of x has been automatically adjusted to accommodate 
the new element and that elements not referenced are set equal to (here 
x(4)). New rows or columns can be added very easily. Try typing r = 
[10 11 12], A = [A;r]. Dimensions in the command must coincide. Try 
r = [13 14], A = [A;r]. 

The command size (A) gives the number of rows and the number of 
columns of A. The output from size (A) is itself a matrix of size 1 x 
2. These numbers can be stored if necessary by the command [m n] = 
size (A). In our previous example, A = [A;r] is a 4 x 3 matrix, so the 
variable m will contain the number 4 and n will contain the number 3. A 
vector is a matrix for which either m or n is equal to 1. If m is equal to 
1, the matrix is a row vector; if n is equal to 1, the matrix is a column 
vector. Matrices and vectors may contain complex numbers. For example, 
the statement 

> A = [1 2;3 4]+j*[5 6;7 8] 
and the statement 

> A = [l+5*j 2+6*j;3+7*j 4+8*j] 

are equivalent, and they both produce the matrix 

A = 
1. 0000+5. OOOOi 2. 0000+6. OOOOi 

3. 0000+7. OOOOi 4. 0000+8. OOOOi 

Note that blanks must be avoided in the second expression for A. Try 
typing 

>A = [1 + 5*j 2 + 6*j 2 + 6*j;3 +7*j 4 + 8*j] 

What is the size of A now? 

MATLAB has several built-in functions to manipulate matrices. The 
special character, ', for prime denotes the transpose of a matrix. The 
statement A=[123;456;78 9]' produces the matrix 
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A = 
14 7 

2 5 8 

3 6 9 

The rows of A' are the column of A, and vice versa. If A is a complex 
matrix, then A is its complex conjugate transpose or hermitian transpose. 
For an "unconjugate" transpose, use the two-character operator dot-prime 
(. '). Matrix and vector variables can be added, subtracted, and multi- 
plied as regular variables if the sizes match. Only matrices of the same 
size can be added or subtracted. There is, however, an easy way to add 
or subtract a common scalar from each element of a matrix. For example, 
x = [1 2 3 4] ,x = x-1 produces the output 

x = 
12 3 4 

x = 

12 3 

As discussed in the chapter on linear algebra (Section 4.1), multiplication 
of two matrices is only valid if the inner sizes of the matrices are equal. 
In other words, A*B is valid if the second size of A (number of columns) 
is the same as the first size of B (number of rows). Let aij represent the 
element of A in the i th row and the j column. Then the matrix A*B 
consists of elements 

n 

fe=l 

where n is the number of columns of A and the number of rows of B. 
Try typing A =[12 3;4 5 6] ;B = [7;8;9]; A*B. You should get the 
result 

ans = 

50 

112 

The inner product between two column vectors x and y is the scalar 
defined as the product x'*y or equivalently as y'*x For example, x = 
[l;2],y = [3 ;4] ,x'*y, leads to the result 

ans = 

11 
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Similarly, for row vectors the inner product is defined as x*y'. The Eu- 
clidean norm of a vector is defined as the square root of the inner product 
between a vector and itself. Try to compute the norm of the vector [1 2 
3 4]. You should get 5.4772. The outer product of two column (row) 
vectors is the matrix x*y' (x'*y). 

Any scalar can multiply or be multiplied by a matrix. The multipli- 
cation is then performed element by element. Try A= [123;456;7 
8 9] ;A*2. You should get 

ans = 
2 4 6 
8 10 12 
14 26 28 

Verify that 2*A gives the same result. 

The inverse of a matrix is computed by using the function inv(A) and 
is only valid if A is square. If the matrix is singular, meaning that it has 
no inverse, a message will appear. Try typing inv(A). You should get 

Warning: ~Matrix~is~close~to~singular~or~badly~scaled. 
Results may be inaccurate. RC0ND=2 .937385e-18 



1.0e+16* 

0.3152 -0.6304 0.3152 

-0.6304 1.2609 -0.6304 

0.3152 -0.6304 0.3152 

The inverse of a matrix may be used to solve a linear system of equations. 
For example, to solve the system 

you could type A = [1 2 3;1 -2 4;0 -2 1] ; b = [2; 7; 3]; 
inv(A)*b and get 

ans = 
1 

-1 
1 



1 


2 


3 




Xl 




2 


1 


-2 


4 




X2 


= 


7 





-2 


1 




%3 




3 



i.2) 



Check to see that this is the correct answer by typing A* [1 ; -1 ; 1] . What 
do you see? 
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MATLAB offers another way to solve linear systems, based on Gauss 
elimination, that is faster than computing the inverse. The syntax is A\b 
and is valid whenever A has the same number of rows as b. Try it. 

The "Dot" Operator. Sometimes you may want to perform an 
operation element by element. In MATLAB, these element-by-element 
operations are called array operations. Of course, matrix addition and 
subtraction are already element-by-element operations. The operation A. 
*B denotes the multiplication, element by element, of the matrices A and 
B. Make two 3x3 matrices, A and B, and try 

> A*B 
> A.+B 

Suppose we want to find the square of each number in A. The proper way 
to specify this calculation is 

3> A_squared=A.~2 

where the period (dot) indicates an "array operation" to be performed 
on each element of A. Without the dot, A is multiplied by A according to 
the rules of matrix multiplication described in Chapter 4, giving a totally 
different result: 

> A-2 

Subtleties. Because MATLAB can do so many different mathematical 
functions with just a few keystrokes, there are times when a very slight 
change in what you type will lead to a different result. Using the matrix 
A entered earlier, type the following two lines: 

» 2.~A 

3> 2 . ~A "/.with a space after the 2. 

In the first case, the dot is "absorbed" by the 2 as a decimal point and the 
" is taken as a matrix exponential. But, when the dot is separated from 
the 2 by a space, it becomes part of the operator (. ") and specifies that 
2 should be raised to the power of each element in A. The point is, you 
should be very careful to type what you mean in an unambiguous way until 
you are familiar enough with MATLAB to know how the subtle situations 
will be interpreted. An unambiguous way of typing the preceding lines is 

3> (2.)~A "/.for matrix exponential 

3> (2).~A "/.for array exponential. 
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8.8 An Introduction to MATLAB: The Colon 8 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

You can use the colon several ways in MATLAB (see help :). Its basic 
meaning is a vector of sequential values. For example, type 

> x = 3:9 

to get 

x = 
3 4 5 6 7 8 9 

For increments other than 1, use statements like 

> x = 1:0.5:4 

> x = 6:-l:0 

Most MATLAB functions will accept vector inputs and produce vector 
out- puts. The statement 

> y = sqrt(l:10) 

builds a vector of integers from 1 to 10 and takes the square root of each 
of those numbers. Try it. 

Now for another subtlety-what is the effect of each of the following 
statements and why? 

> 1+1:5 

> 1+(1:5) 

Appending to a Matrix or Vector. A matrix or vector can be enlarged 
in size by appending new values to the old values. Let x=[l 3 5]: 



*.3) 



X = 


[x6810] => x = 


[1356810] 


y = 


[x; 1 : 6] => y = 


1 3 5 6 8 10 
12 3 4 5 6 



s This content is available online at <http://cnx.Org/content/m21395/l.4/>. 
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8.9 An Introduction to MATLAB: Graphics 9 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

In "Complex Numbers" (Section 1.1), you learn that complex variables 
can be represented as points in the plane. MATLAB makes it easy for you 
to plot complex variables in a graph. Type zl = l+.5*j ;plot (zl, 'o')- 
The graph window should be activated and the point zl displayed by a 
'o'. You must specify the symbol for display, and the authorized symbols 
for point display are ' . ' , ' o ' , ' + ' , and ' * ' . When you are displaying 
a curve (to come later), no type is necessary. MATLAB automatically 
adjusts the scale on a graph to accommodate the value of the point being 
plotted. In this case, the range is [0,2] for the real part and [0, 1] for the 
imaginary part. 

Let's now plot a second complex number by typing z2 = 2+1. 5* j; 
plot (za , ' o ' ) • Note that the second plot command erases the first plot 
and changes the scaling to [0,4] and [0,3]. Sometimes you may want to 
have the points plotted on the same graph. To achieve this, you have to 
use the command hold on after the first plot. Try the following: 

> plot(z2, 'o') 
3> hold on 

> plot(zl.'o') 

> hold off 

The advantage in using the hold command is that there is no limit to 
the number of plot commands you can type before the hold is turned off, 
and these plots may involve the same variable plotted over a range of 
values. You can also use different point displays. A disadvantage of the 
hold command is that the scaling is enforced by the first plot and is not 
adjusted for subsequent plots. This is why we plot the point z2 first. Try 
reversing the order of the plots and see what happens. This means that 
points outside the scaling will not be displayed. The command hold off 
permits erasing the current graph for the next plot command. 

You can freeze the scaling of the graph by using the command axis. 
MATLAB gives you the message 

Axis~scales~f rozen 



9 This content is available online at <http://cnx.Org/content/m21388/l.5/>. 



CHAPTER 8. AN INTRODUCTION TO 

MATLAB 

ans = 

4 3 

This freezes the current axis scaling for subsequent plots. Similarly, if you 
type axis a second time, MATLAB resumes the automatic scaling feature 
and prints the message 

Axis~scales~auto-ranged 
ans = 

4 3 

The axis scaling can also be manually enforced by using the command 

3> axis ( [xmin xmax ymin ymax] ) 

where (xmin, ymin) is the lower left corner and (xmax, ymax) is the 
upper right corner of the graph. This scaling remains in effect until the 
next axis command is entered (with or without arguments). 

Another way to plot several complex numbers on the same graph is to 
display them as a curve. For this purpose, you have to store the numbers 
in a vector. For example, type zl = zl,z(2) = z2,plot(z). Note that 
the two points are at the two extremes of the line plotted on the graph. 
If you specify a symbol, then no line is drawn, just the extreme points. 
Try plot(z.'o') . 

If you examine your current graph carefully, you will notice that the 
unit lengths on the x and y axes are not quite the same. In fact, MATLAB 
adjusts the length of an axis to conform to the overall size of the graph 
window. What this means is that a 45° line will actually be displayed at 
an angle depending on the overall aspect ratio of the graph window. To 
ensure that the aspect ratio is equal to 1, you may enter the command 
axis(' square')- MATLAB will then enforce an aspect ratio equal to 1, 
regardless of the aspect ratio for the outside graph window. This ensures 
that circles appear as circles and not as ellipses. MATLAB will make the 
square graph as large as possible to fit within the graph window. To go 
back to the default ratio, just type in axis( 'normal'). 

To add labels to your graph, the functions xlabel('text'), 
ylabel('text '), and title ('text ' ) are useful and self-explanatory. 
The argument text contains a string of characters. Add the label Real 
on the horizontal axis and the label Imaginary on the vertical axis of 
your graph. The command grid draws a grid on your graph. The grid 
does not remain in effect for the next plots. Try it. 

The plot Instruction. The plot instruction in MATLAB is very 
versatile. It can be used to plot several different types of data. Its syn- 
tax is plot (x,y, ' symbol and/or color ') or plot (y, ' symbol and/or 
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color' ) . The instruction will plot a vector of data versus another vector 
of data. The first vector is referenced to the horizontal axis and the second 
to the vertical axis. If only one vector is used, then it is plotted with ref- 
erence to the vertical axis while the horizontal axis is automatically forced 
to be the index of the vector for the corresponding data point. The nota- 
tion inside the apostrophes is optionally used to designate whether each 
element of the vector is to be plotted as a single point with a certain sym- 
bol or as a curve with a straight line drawn between each data value. The 
colors can also be specified. Possible symbols are (*,o,+, .), and colors 
are (r,g,b,w) (red, green, blue, and white). Complex valued vectors are 
plotted by making the horizontal axis the real part of the vector and the 
vertical axis the imaginary part. Warning: A complex valued vector will 
automatically be plotted correctly on the complex plane (instead of real 
versus imaginary) only if every element of the vector is complex valued. 
Try plot (x,y,'*') , plot (x,'*'),plot (y,'*'),plot (y,x,'*') 
and plot (z,'*'),plot (Real (z) , Imag (z) , '*') to clarify your un- 
derstanding of plot. Use x = [1357] , y = [2468] ,z=[l+j,2 + 2j, 3 + 3j]. 
We may summarize as follows: 



pl0t(x, '*r') 


(red star — points with the values 
of x on vertical and indicies on 
horizontal) 


plot(y) 


(line — connected curve of the 
value of y on vertical and the 
value of x on horizontal) 


plot(x,y, 'og') 


(line — connected curve of the 
value of y on vertical and the 
value of x on horizontal) 


plot(x,y, 'og') 


(circle — points of the value of y 
on vertical and the value of x on 
horizontal) 


continued on next page 
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plot (real (z) , imag(z) ) 


(line — connectedplot of z on the 
complex plane) 


plot (real (z) ,imag(z) , '+b') 


(blue plus — points of z on the 
complex plane). 



Table 8.1 



subplot( 2 2 3) 



subplotC 2 12) 



subplott 12 1) 



1 
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m 


4 



m 



m 


2 



Figure 8.3 



Subplots. It is possible to split the graphics screen up into several 
separate smaller graphs rather than just one large graph. As many as 
four subplots can be created. The MATLAB instruction subplot (mnp) 
signifies which of the smaller graphs is to be accessed with the next plot 
statement. The mnp argument consists of three digits. The m and n are 
the numbers of rows (m) and columns (n) into which the screen should be 
divided. The p designates which of the matrix elements is to be used. For 
example, 

Help and Demos. MATLAB has on-line help and a collection of 
demonstrations. For a list of available functions, type 

> help 

For help on a specific function, sin for example, type 
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3> help sin 

To learn how to use colon (;, a very important and versatile character) in 
MATLAB, type 

> help : 

The demos will also help you become more familiar with MATLAB and 
its capabilities. To run them, type 

3> demo 



8.10 An Introduction to MATLAB: Editing 
Files and Creating Functions (Macintosh) 10 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

If you quit MATLAB now, all the commands you have typed will be lost. 
This is where the Edit window is useful. If you choose new from the File 
menu, a new window appears with the title Edit 1: Untitled. In this 
window, you should type in all the commands you would like MATLAB 
to execute at once. When you are finished typing, you may save the file 
by choosing save or save as in the file menu and by entering a name for 
the file. If the edit window is active (that is, if it appears in front), then 
choose save and go from the file menu to save the file and execute it. If 
the command window is active, then you can execute the file by entering 
its name. 

Editing Files. To test your understanding of file editing, enter the 
following commands in a file named myfile: 



clear, ~clg '/Clear" variables~and~grapriics 

j=sqrt (-1) ; °/,To~be~sure 

zl=l+.5*j ,z2=2+1.5*j '/Enter~variables 

z3=zl+z2,z4=zl*z2 '/Compute" sum" arid~product 

axis([0~4~0~4]) , '/.First "plot 
axis( ' square') ,plot (zl, 'o' ) 



10 
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hold~on °/.Allow~overplot 

plot(z2, 'o') ,plot(z3, ' + ') , °/.Other~plots 

plot(z4, '*') 
hold~off 

You do not have to type the % sign and the text that follows it. These are 
simply comments in a file. They are ignored by the MATLAB interpreter. 
You should, however, make a habit of adding comments (preceded by %) 
to your file if you want to be able to understand programs that have been 
written long ago. 

Do not forget to save your file. Such a file is called a script file. It 
contains MATLAB commands that could have been entered one by one 
in the command window. You have three ways to execute a script file: 

i. with the edit window active, choose save and go from the file menu; 
ii. with the command window active, enter the file name; or 
iii. with the command window active, choose run script... from the Af- 
file menu. In this case, a menu pops up to ask you which file you 
want to execute. 

Try each of these three methods in order to get used to their differences. 
Figure 1 (Figure 8.4) shows the plot that you should get. 

Creating Functions. MATLAB puts many commands at your dis- 
posal, and you just have to enter their names (with or without arguments) 
to execute them. Some commands are built in to MATLAB, and others 
are contained in files to which you have access (not to modify them, but 
to see how things are done). You can try to display the contents of a 
command file in the command window by entering the command type 
filename. Enter type plot. You should get the message 

??? Built-in function. 
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* File Edit Gallery Graph Window 




Figure 8.4: A Typical Graph (Computer, Inc., used with permis- 
sion.) 



This means that the command plot is a build-in function and thus cannot 
be typed by the user (it is compiled with the program). Similarly, try 
to type the function file containing the command sinh by entering the 
command type sinh. You should get 



function~y=sinh(x) 

y.SINH~SINH(X)~is~the~hyperbolic~sine~of~the~elements~of~X. 
y= (exp (x) -exp (-x) ) II ; 

This is a typical example of a function file. It differs from a script 
file by the fact that the first line contains the word function. What 
it does is make the command y = sinh(x) equivalent to the command 
y=(exp(x)-exp(-x))/2 . The variable x is the input argument (there 
could be more than one), and y is the output argument (there also could 
be more than one). The second line contains comments about the func- 
tion and its arguments. They can spread to several lines. Display them 
by typing the command help sinh. The third line contains the actual 
function commands (there could also be several lines). 
As an exercise, enter the function perp(x): 
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function~y=perp(x) 

7,PERP~PERP(X) ~is~a~complex~value~perpendicular~to~X. 

j=sqrt(-l); 

y=j*real(x) -imag(x) ; 

Evaluate perp on various complex numbers. Replace the last line by y = 
x*j;. Do you get the same result? Why? 

Note that local variables are just that-iocai. Only the input and out- 
put arguments are kept in memory after the function is called and exe- 
cuted. For more on functions and multiple arguments, see the MATLAB 
manual. In the previous example, the variable j is local. If, before using 
the function perp, you use the same variable j, its contents will not be 
affected by the command perp(z). Verify this. 

Normally, while a file (script or function) is executed, the commands 
are not displayed on the command window. Just the results are displayed. 
The command echo allows you to view all the instructions. This is useful 
for debugging and demonstrations. It is turned off by typing echo off. 

8.11 An Introduction to MATLAB: Editing 
Files and Creating Functions (PC) 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

You should write a MATLAB program whenever you anticipate exe- cut- 
ing some sequence of statements several times or again in a later session. 
On an IBM PC, you may use any text editor to write a program, as long 
as the file can be saved in ASCII format without the control codes used 
by most word processors. Applicable text editors include Edix, Wordstar, 
XTree Pro, and Turbo Pascal's editor. 

Editing Files. If you have enough memory, you can run your editor 
without leaving MATLAB by using the exclamation point (!), like this: 

> IEDIX 

The exclamation point may be used to execute any DOS command or 
program from MATLAB. When the command or program finishes, your 
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MATLAB variables are just as you left them. Use your editor to write 
program lines just as you would type them in MATLAB's command mode. 
Then save the file with extension .m in the directory where you will run 
MATLAB. Such MATLAB programs are called m-files. You may run your 
m-file by typing the file name (without the .m extension) at the MATLAB 
command prompt (3>). 

Script Files. There are two kinds of m-files, called script files and 
functions. Running a script file is exactly like typing the commands it 
contains at the 3> prompt. Your m-file will automatically be a script 
file unless you specify otherwise, as described later. Practice by entering, 
saving, and running plotsin.m as listed next: 

t~=~-6: .2:6; 
y~=~sin(t) ; 
plot(t,y) 
title('SINE') 
pause 
grid 

xlabel('t') 
ylabeK'sin(t)') 

When the pause is executed, you will need to press a key to go on. If 
you type whos after running plot sin, you will see that the variables t 
and y remain in memory. Comments are important to a script file. They 
are marked with the symbol %. Anything following this symbol on a line 
is assumed to be a comment and is ignored by the MATLAB program 
interpreter. 

Functions. Functions differ from script files in that they have des- 
ignated input and output variables. Any other variables used within a 
function are local variables, which do not remain after the function ter- 
minates and which have no effect on variables outside the function. Many 
of the functions supplied with MATLAB are actually m-files. A good 
example is triu.m: 

3> type triu 

The word function at the beginning of the file makes it a function rather 
than a script file. The function name in this line must match the file 
name. The input variables of triu are x and k, meaning that the first 
input argument will be referred to as x and the second as k within the 
function. Likewise, the function line designates y as the output. There is 
nothing special about the variable names x,k, and y when the function is 
used. It is only that whatever inputs and output you use will be referred 
to as x,k, and y inside the function. The variables m,n, j , and i are created 



CHAPTER 8. AN INTRODUCTION TO 

ZOO 

MATLAB 

temporarily when triii runs and disappear when it terminates. They are 
local variables and have no effect on variables with the same names outside 
the function. In contrast, a script file has no local variables and does no 
substitution of input and output variable names. 

As an exercise, enter and save the function perp.m: 



function~y=perp(x) 
°/,~PERP (x) ~is~a~complex~number~perpendicular~to~x . 

j~=~sqrt(-l); 

y~=~j*real(x)-imag(x) ; 

Evaluate perp on various complex numbers. Replace the last line by y = 
x*j ;. Do you get the same result? Why? 

Printing Files and Graphics. To display an m-file on the screen, 
use the instruction 3> type filename. To make a copy at a printer, 
use the DOS command 3> ! print filename. m. Graphics hardcopy is 
available through the commands meta and gpp. See the MATLAB manual 
for more information. 

8.12 An Introduction to MATLAB: Loops and 
Control 12 

note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

MATLAB has control statements like those in most computer languages. 
We will only study the for loop here. See the MATLAB manual for 
details on if and while statements. 

What for loops do is allow a statement or a group of statements to be 
repeated. For example, 

for i = l:n,x(i) = 0,end 

assigns the value to the first n elements of the array x. If n is less than 1, 
the instruction is still valid but nothing will be done. If n is not defined, 
then the following message will appear: 

???~Undef ined~function~or~ variable. 
Symbol" in~question==>n 
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If n contains a real value, the integer part of n is used. If n is a complex 
number, the integer part of the real part is taken. (This should, however, 
be avoided.) If x is not declared earlier or is of smaller dimension than n, 
then extra memory is allocated. 

The command end must follow the command for. If it is not present, 
MATLAB will wait for remaining statements until you type the command 
end, and nothing will be executed in the meantime. 

More than one statement may be included in the loop. The statement 
1 : n is the way to specify all the integer values between 1 and n. A 
step different than 1 may be specified. For example, the statement for 
i=l :2:5,x(i)=l,end is equivalent tox(l)=l,x(5)=l. Negative steps are 
also allowed, as in i=n: -1 : 1. 

We may use a for loop to draw a circle of radius 1. Type 

> j=sqrt(-l); 
> n=360; 

3> for i=l :n, circle(l)=exp(2*j*i*pi/n) ;end; 
3>plot (circle) 

Note how easy it is to plot a curve. But also note how slowly the for loop 
is executed. MATLAB is not very good at executing things one by one. It 
prefers, by far, a vector-oriented statement. Using the range specification 
as in the for loop, it is possible to speed up the process by replacing the 
explicit for loop by an implicit for loop using the colon, like this: 

> circle = exp( (2*j*pi/n) * [1 :n] ) ; 

Note how much faster this command is executed. In general, for loops 
should be avoided as much as possible. For example, the first for loop 
you typed could have been replaced by the command x=zeros(l,n) ;, 
which is much more efficient. The function zeros fills the variable with 
O's to the specified size. Similarly, the function ones fills the variable with 
l's. The size can also be determined by the size of the argument. If A is a 
matrix of size m,n, then the command B=ones(a) fills the matrix B with 
l's and forces the matrix B to have exactly the same size as the matrix A. 
Avoiding for Loops. Since for loops are very inefficient in MAT- 
LAB (they are computed sequentially, adding several more computations 
for every loop) , it is preferable to use the matrix capabilities of MATLAB 
to replace for loops and speed up processing time. 

i. Replace the for loop 

> for i = 1:10, 
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> x(i) = i; 

> end; 

with 



> x = 1:10 
to get 

x= [123456789 10] 
ii. Replace the for loop 

3> z = something; 

> for i = 1:10, 

> x(i) = z*i; 

> end; 

with 



3> z = something 
> x = z*(l:10); 

to get 



x = [z 2*z 3*z . . . 10*z] 
iii. Replace the for loop 

3> z = something; 

> x(l) = z; 

> for i = 2:10. 

> x(i) = z*x(i-l); 

> end; 

with 



3> z = something; 
> x = z."(l:10); 

to get 
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x = [z z **2 z**3 . . . z**10] 
iv. Replace the for loop 



> for i = 0:2:100, 

> x(i) = 1.0*exp(j*2*pi*i/100) ; 

> end; 

with 



> x = 1.0*exp(j*2*pi*(0:2:100)/100) ; 

to get 



x= [exp(0) exp(j*4*pi/100) ... exp(j*200*pi/100)] 
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Chapter 9 

The Edix Editor' 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

On a PC, creating and editing m-files is done outside of MATLAB. The 
Edix editor is one of the visual types of editors. It can be accessed either 
from DOS by using > edix filename. m or from MATLAB by using 3> 
ledix filename. m. The latter will return you back to MATLAB after 
you quit the editor. MATLAB script files must end with a .m exten- 
sion. They are also called m-files. Once in the Edix editor, a help list of 
the editor's commands can be displayed on the screen by typing "Alt-h." 
(Note: The "Alt" key must be held down while the "h" key is depressed.) 
Pressing the "space" key will get you out of the help system. 

A new file is created by calling the Edix editor with a file name that 
has not been previously used. If the file name already exists on disc, 
then that file is retrieved and displayed on the screen and is ready to 
be edited. Since Edix is a visual editor, changes are made by moving 
the cursor to wherever something needs to be typed in or deleted. Once 
changes have been made to a file, then that file needs to be saved (written 
to disc) by typing "Alt-w." When all editing is finished, you may exit from 
the Edix editor by typing "Alt-x." Following are some useful Edix editor 
commands: 



1 This content is available online at <http://cnx.Org/content/m21477/l.4/>. 
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Alt-h(F7) 


help-list of all the Edix com- 
mands; 


Alt-w 


saves (writes) the file to disc; 


Alt-x 


exits the Edix editor; 


Alt-d 


deletes the current line; 


Alt-m (F8) 


the first time used, marks the be- 
ginning of a block of lines to be 
edited; the second time, marks 
the end of a block of lines to be 
edited and highlights this block in 
white; the third time, "un-marks" 
the highlighted block; 


Alt-c 


makes a copy of the highlighted 
block at the current cursor loca- 
tion (can be repeated); 


Alt-m 


(moves the highlighted block to 
the current cursor location (can 
be repeated); 


(F5) 


put the cursor at the beginning of 
the line; and 


(F6) 


puts the cursor at the end of the 
line. 
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Chapter 10 

Useful Mathematical 
Identities 1 



note: This module is part of the collection, A First Course in 
Electrical and Computer Engineering. The LaTeX source files 
for this collection were created using an optical character recog- 
nition technology, and because of this process there may be more 
errors than usual. Please contact us if you discover any errors. 

10.1 e j6/ , cos 9, and sin 9 

&» = lim (1 +j e -) n = EZo h.WT = C03 ° + J sin0 

COSO — l^ n=0 ( 2 „)! ° i smu — l^ n =0 (2n+l)r 
rn „f) _ y->°° (~l)" ff2n. -^ _ y^oo (-1)" g2n+l 
cosp — 2^n=Q (2n)l P ' SmP ~~ 2^n=0 (2n+l)! P 

10.2 Trigonometric Identities 



sm 2 6> + cos 2 6> = 1 (10.1) 

sin (6 + 4>) = sinOcoscj) + cosOsirxj) (10-2) 

cos {9 + <f>) = cosOcoscp — sin9sin(f> (10.3) 
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sin (6 — 4>) = sinOcoscf) — cos9sin<f> (10-4) 

cos (9 — <f>) = cosOcoscp + sin8sin(j) (10.5) 



10.3 Euler's Equations 



e je = cos6 + jsin0 (10.6) 



e^ 9 - e-J' 6 



sin6 = (10.7) 

2j K ' 



ei e + e-i b 



n=0 V " 

N 



,, i (N-n)\n\ 



(lOi 



10.4 De Moivre's Identity 

(cos6 + jsin9) n = cosnO + jsinnO (10.9) 

10.5 Binomial Expansion 



i* + ,) K -±r.w-.i"\-7*^ (-,o, 



2" = E I W I (10.11) 



n=0 



II 



k=0 
N-l 



10.7 Taylor's Series 



k\ 

k=0 
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10.6 Geometric Sums 

oo 

Yaz k = -?— \z\ < 1 (10.12) 

^-^ 1 — z 



v- / a (1 - z N ) 

J2 az k = -±— '- z £ 1 (10.13) 

fc=0 



/( a ) = £/«(o)fc^L (10.14) 



(Maclaurin's Series if a = 0) (10.15) 
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Index of Keywords and Terms 

Keywords are listed by the section with that keyword (page num- 
bers are in parentheses). Keywords do not necessarily appear in the 
text of the page. They are merely associated with that section. Ex. 
apples, § 1.1 (1) Terms are referenced by the page they appear on. 
Ex. apples, 1 



A 


algebra, § 1.3(16) 




averages, § 6.3(216) 
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§5.6 


;iso), 


§ 5.7(188), 


§5.8 


;i95), 


§ 6.1(203), 
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§7.3 
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;254), 
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Euler, § 2.4(54) 

filtering, § 6.1(203), 
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§ 5.5(176), § 5.6(180) 
Huffman, § 7.4(246) 
huffman codes, § 7.6(263) 

I Identities, § 2.4(54), 
§ 10(295) 
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§ 5.2(166) 

image transformations, 
§ 5.3(172) 

inner product, § 4.3(117) 
interference patterns, 
§ 3.8(106) 
introduction, § 1.1(9) 

L light scattering by a slit, 
§3.7(99) 

linear algebra, § 4.1(109), 
§ 4.2(112), § 4.3(117), 
§ 4.4(120), § 4.5(127), 
§ 4.6(133), § 4.7(137), 
§ 4.8(146), § 4.9(155), 
§ 4.10(161) 
lissajous figures, § 3.5(86) 

M math, § 1.1(9) 

MATLAB, § 8.1(265), 
§ 8.2(266), § 8.3(268), 
§ 8.4(269), § 8.5(270), 
§ 8.7(273), § 8.8(278), 
§ 8.9(279), § 8.10(283), 
§ 8.11(286), § 8.12(288) 
MATLAB,, § (3) 
matrices, § 4.7(137) 
multiphase power, § 3.4(83) 

N norms, § 4.6(133) 

numerical experiment, 
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§ 2.7(65), § 3.8(106), 
§ 5.8(195) 

P phasor, § 3.7(99) 

phasors, § 3.1(69), § 3.2(70), 
§ 3.3(80), § 3.4(83), § 3.5(86), 
§ 3.6(89), § 3.8(106) 

Q quadratic equations, 
§ 1-4(25) 
quadratic roots, § 1.7(39) 

R roots, § 1.4(25) 

roots of unity, § 2.5(57) 

S series RLC circuit, § 3.6(89) 
signals, § 3.2(70) 
simple averages, § 6.2(209) 
sinusoidal steady state, 



§ 3.6(89) 

star field, § 5.8(195) 
systems of equations, 
§ 4.8(146) 

T test sequences, § 6.6(223) 
transformations, § 5.4(174) 

U unit circle, § 2.3(49) 

V vector graphics, § 5.1(163), 
§ 5.2(166), § 5.3(172), 
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